What is the pH of your local tap water ?
If its slightly acidic it will disolve your rock / gravel and the pH will just rise to the tanks natural buffer level - generally it will be slightly alkaline.
The only reliable way to maintain acidic water is to use a completely neutral media such as...