Small terra cotta flower pots make good caves when turned over on their side. PVC elbows with aquarium gravel glued on them with aquarium sealant makes good ones as well. Ive also seen some great ones made out of Coconut shells.
And as Billy stated, Rocks stacked in the tank can be good as well. Tis all limited by the imagination.