Hi Freeze
If you have unstable PH levels I suggest you check you GH and KH levels for the tank and tap water.
The interesting reading would be the KH it is the buffering capacity for the PH. If this figure is low you will find that the PH will fluctuate.
Firstly check the PH levels of your tap water again, but after it has stood for a while, it might be a bit higher after standing. Then test the GH and KH and post all reading on here and we will see what we can make of it.
To reduce the PH in the actual tank, a natural way would be to add some bogwood.
Also have a read of this post which is very interesting
Water
Let us know how you get on
edit: If readings show a low KH what can help is to reduce the PH naturally i.e. with the bogwood and do smaller water changes i.e. 10% instead of 20% because it is less of a shock to the fish.
I do not advocate to let NitrAte levels rise but in your case they are very low so a small rise would not do any harm. NitrAte is actually Nitric Acid and it also has a reducing effect on the PH levels.
HTH