I have them everywhere too.. they really don't bother anything. Just a pain in the rear end.
possibly, my rocks were just covered in them, the back and bottom of the rocks especially. Given that there is only 1 coral (and an anemone), I'll just remove the rock, give it a bath, let it dry out, and use it for whatever (if I can't sell it).