You need to be aware that some palythoas produce Palytoxin, a poison that is notoriously random in its effects. Some people can handle Palys with their bare hands for years with no trouble but then one day it decides to pump out some palytoxin and the entire house is evacuated to the hospital.
Most cases are due to people doing things like trying to boil off Palys from rock on the stove, use a pressure washer, etc, but other cases the person has no idea what they didn’t and despite using gloves, safety goggles, and hand washing they end up blind.
Both of the examples I gave are real. If it was me I’d get rid of those rocks and replace it with something less…hazmat-y.