First off, goldfish need at least 20 gallons, but for comet goldfish they need 40+ gallons or a pond, as they can grow well over 10 inches. Colorful gravel and fake colorful decor is not good at all, so upgrade to a natural sand or fine gravel, and maybe put some rocks or driftwood in.
Questions:
Did you cycle the tank?
What size tank was he in before?
Are there any other fish?
Very important - What are the water parameters? (Ammonia, nitrite, and nitrate)
What filter do you have for the tank?
What is the temperature?
Did you transfer any of the decor, sand, or water from the old tank to the new tank?
A picture of all the tank would be helpful.