If you have the orange ones, they will not harm anything, and they are a good food source for several fish.
Some people find them unatractive, but I like them. There is some species of flatworms that will eat corals, so if you have those you will need to do something. YOu probaly have the common orange type that wont hurt anything, but they may be unatractive to you.