White flies on honeysuckle

They are smaller than aphids and have white powdery wings like moths. They have been on it all summer but I brushed it the other day and LOADS flew off! They don't seem to be having an adverse effect on the honeysuckle and nothing nearby seems to have them. Anything to worry about?
The honeysuckle is thomas something.

 

Whitefly are a persistant pest and you should endeavour to get rid of them they can be plant specific (only affect one plant) but are sap suckers and leave deposits of honeydew which in turn can lead to sooty mould.You can use sprays containing Imidacloprid it's available as a concentrate foliage spray (Provado Ultimate Bug Killer);