Yes you can, but it would need a very very good clean. Especially if your gonna put it in a freshwater set-up.
Cheap play sand does seem like the better option. Still needs cleaning but at least you'll know there's no funny bugs and/or pollution in there.