I believe you just nicely removed them . They just hitch on in. One of my tanks I had a few show up after several years and no additions. I wouldn't do anything more than you've already done. You could scrape that frag with a toothbrush, but do it outside of the tank.