Just letting it sit doesn't help lot, because gas-changing happens on surface. And if chlorine is binded, letting it sit doesn't help at all.
You need to aerate(?) water with pump+stone, then the "free chlorine" leaves from water (but binded chlorine is still in water).
If your water isn't very good quality, you should use water conditioners.