Worms are just extra protein. Won't hurt you at all and like was mentioned earlier, a lot of fish on the Gulf coast have them. I've seem them in bass/specks on the causeway to drums in the bay to AJ's offshore. They eat the same as the rest of the fish.
As far as triggers, The filet is as good a eating fish there is but the real delicacy is the throat. Captain Jab turned me on to them a few years ago and I still thank him from time to time. Best tip I have ever received on fish cleaning/eating.