That's why we always stress to add no more than 3 ppm ammonia
Until a year or two ago, i was always a firm believer that the bacteria lived in the filter. Then two things happened.
My main tank has been running for 7 years, but the filter, substrate and decor came from a smaller tank when I upgraded. I've had slow growing plants for many years, and around 2016 added water sprite, which I've now replaced with frogbit.
A couple of years ago I forgot to turn the filter on after a water change and only found out a week later when I came to do the next water change. My reaction was to grab my test kit - but there was no trace of ammonia or nitrite in the water.
At the end of 2019 I saw some fish that I wanted to buy so I went home and set up my quarantine tank. I took some media from my main tank and to be on the safe side I added 3 ppm ammonia. Before going buying the fish, I tested the QT. 3 ppm ammonia. Next day 3 ppm. And the next day and the day after that. I ended up doing a 7 week fishless cycle by which time all the fish I wanted had been sold
These incidents tell me that I have few, if any, bacteria in my filter media.
When I set up the QT again late last year I didn't bother with any mature media. I took the last bit of water sprite from my main tank then went to the shop and bought fish and 2 bunches of elodea (anacharis) which I left floating in the QT. I tested every day and never saw any ammonia even with 12 kuhli loaches in an overstocked 25 litre/6.6 gallon tank.
But I still don't dare clean the filter media in tap water.