Does moss between paving stones 'add character'?

Assume your paving stones looked like this (see attached).

Would you dig out the moss that's grown between the gaps? Admittedly it is quite brown looking rather than green (I may have sprayed it last year at some point).

My neighbour says he typically leaves moss because he feels it adds character.

Thoughts?

 

I'm guessing it makes them more slippery in the winter.