"Aggressive" in this context probably means "will eat anything it can readily subdue". Lack of visible aggression just means they haven't had a reason to act aggressive yet, probably due to all the food and shells easily available.
If you want to collect shells safely, try clam and other bivalve shells. You can easily see those have no critters in them. Snail shells are best left behind anyway, so hermits can use them. Besides, most intact snail shells you find at the beach will be occupied by either snails or hermits- that's why it's still intact.
Active, vigorous midwater fish should be just fine with them. Corals are probably iffy at best. Though you could keep corals on frag racks attached to the walls, as they won't be able to climb up and eat those.