Definately take it out and bury it, it will first atrack unwanted visitors like vermin which will contaminate the water and if the fish had fin rot then by keeping it in water it will most likely spread the desease or cause another type of suffering to the fish.