Sweet Green Peppers

My peppers are now about 'fist' size and turning green to red; but most of the stems seem withered - not like you'd by from a greengrocer. Also, found small holes in the peppers themselves, about the size of a match head. One evening last week I found slugs all over the plant so have started bringing in to greenhouse every evening and put out again next morning.

Any ideas, when I should pick and if they will be edible or full of slugs?

 

Could be earwigs a number of times I have picked reasonable sized bell peppers and cut them open to find a number of earwigs that had eaten the seeds.
I would pick and use the ones with withered stalks as soon as possible.