That is interesting because I have a 3-4 month old coral 40 gallon tank and the yellow polyps are disappearing like candy. The only things in the tank are a cleaner shrimp, a hitch hiker crab (very small and white that stays that the bottom) and an algae blenny. I can't figure it out.
What's the water testing at? The tank isn't very old, and that could be an issue. Never seen a cleaner (or any other shrimp) bother yellow polyps, but an unknown crab might.