It's unusual, certainly... it probably wouldn't be that big of a risk to put him back in the tank, as long as he is smaller than all of the fish.
There is a Red Claw Crab hiding in one of my rocks, and he is fairly large; so far, he has not attacked anything.
-Lynden