I wouldn’t worry to much. You could try and get it off. You may lose a single polyp it you glue where the polyp comes out. Or it may push its way through
Pro tip for next time. If you're mounting it and you get some glue on a polyp (or other un-wanted place) don't touch it, complete the mount and allow it to harden (either in your aquarium or the working container). Once its done 'drying' you can simply pop the glue off.