leave it on all the time. the bacteria in the filter need to stay wet to stay alive -- if your bacteria die, you'll have to cycle your tank all over again.
Yea,your filter media needs a constant flow of water to keep the bacteria alive. Turning it off will just be running a filter for nothing. Much like not having one at all.