There are several types of paint that are specially made for aquatic use. Ask for a suitable paint at your fish shop. I don't know where you are so can't suggest a product.
Many paints are actually pretty inert once FULLY dried.
You can get aquarium safe paint at AES
It is mainly used for people who are building plywood tanks so you cant get it in a small amount which means it will be expensive.