You'll have to use chemicals anyway. Not necessarily to up the pH as yes, the sand and rock do have a buffering capacity, but you'll probably have to use chemicals to remove heavy metals, ammonia, nitrates, chlorine.
I use RO/DI water. Here is an excellent explanation from our Resource center...