Calcium is the main mineral measured as hardness or GH. The only way to lower the amount in tap water is to mix it with pure water such as reverse osmosis (RO) water or distilled or deionised water, which have zero mineral content.
Do you know the hardness of your tap water?
Do you do regular weekly water changes or do you top up when the water level drops? If you top up regularly this will increase the amount of minerals even with soft water as water evaporates but the minerals stay in the tank.