My other concern is I wouldn't have calibration solution when the time comes to change reagents if I did that. It sounded like you should calibrate each time.
It certainly isn't a bad idea. In part it will depend on the numbers you get immediately after changing reagents as compared to those just before.
If the numbers are in the same ballpark, don't recalibrate. If they're off more than you'd like, recalibrate.