capsaicin will get rid of the worms and actually protect against most insects. I'd post a link, but since I'm new here that option is disabled for me.
Here's a recipe copy/pasted from the National Geographic green living website.
organic pepper spray can be purchased at nurseries and garden centers or made at home by pulverizing two hot peppers in a blender with a few cups of water. Use chili, habanero or any hot pepper variety in the Capsicum genus. Pour the pulverized pepper into a gallon container and add enough water to make a gallon of concentrate. Allow it to stand at least 24 hours, and then run it through a sieve and add 1/4 cup of concentrate to a gallon of water and load into a sprayer. Be sure to dilute fully or the mixture may "burn" your plants. Add 2 tablespoons of natural, biodegradable dish soap like castile soap to help the mixture adhere to the plants. Wear gloves when preparing and using the spray. Cover plants thoroughly with the spray. Repeat if needed.