Lightly I believe, just clean off the surface, but do it regularly. I used to deep-clean my gravel, and then realised that probably removing all these 'nutrients' from the area the roots where in wasn't a good idea, (especially as I feed my plants by putting NLB clay balls into the gravel near their bases!) - lol