It wouldn't hurt for people to actually understand what is really happening with test kits, to avoid stress, anxiety and confusion regarding them. Virtually all calcium test kits on the
market are doing the same basic analysis: An EDTA titration of calcium, using an indicator dye, after first precipitating magnesium as the hydroxide.
What did Jim just say? Was that English?
EDTA is a big molecule that likes to grab onto metal ions, like calcium, magnesium, strontium, and so on. There are various indicator dye molecules that also like to grab onto these metal ions. The "strength" with which EDTA grabs the metal ions is stronger than the "strength" of the dyes, so EDTA will strip the metal ions away from the dye molecules. The dye molecules are one color when they have metal ions attached (pink), and change color (to blue) when they are "naked", or when the EDTA has grabbed all the metal ions. This is the classic "pink to purple to blue" color change. By measuring the amount of EDTA it takes to gobble up all the metal ions to the point where it causes the color change, we can know the amount (in "moles") of metal ions that were in the water.
To get just calcium results, we have to do something about all that magnesium in the water. The classic solution to this problem exploits the fact that magnesium hydroxide is extremely insoluble in water, and so either sodium or potassium hydroxide is added, which almost immediately causes the cloudy white precipitate that is magnesium hydroxide. The magnesium "grabs" onto the hydroxide so strongly that neither the dye nor the EDTA can get ahold of it, and so it is just like it wasn't there. Another thing the hydroxide does is to get the pH of the solution in the right range for the dye to do it's color change thing properly.
How much hydroxide is necessary? Enough to get the job done, but adding too much won't hurt anything. Adding too little will leave some magnesium in solution, and will cause the test to read high.
As far as the amount of dye necessary, you really only need enough to see the color well enough to detect the color change. Adding too little or too much dye doesn't really hurt anything, either.
Measuring the amount of EDTA titrant accurately is the one really important part of the calcium test.
EDIT: One minor note: Any strontium in the water is still present, and acts just like calcium in these titrations, so most calcium test kits actually are calcium + strontium test kits. Remember I said that we are measuring moles of metal ions. Strontium weighs about twice what calcium does, so that means that 8PPM strontium in your water would mean a 4PPM error in the calcium reading. Some test kit manufacturers may attempt to factor this error into the results calculation by guessing how much strontium you might have in your tank, and others likely just ignore this error. In any event, the error is likely very small, but I just wanted to mention it.