From what I have learned you want to use aquarium safe silicone. I guess other silicon can seep chemicals into your tank. I had a big thing of silicone that I could put in a caulking gun too, but it is not for aquariums. I wouldn't use anything that doesn't say aquarium safe. For 3 bucks for 3 oz. its worth your fishes life. Usually, the silicone will say on the back, Not recommended for aquarium use.
PVC is usually that white plastic drainage piping you see that is used for plumbing. It comes in super long lenths and also in curves and other interesting and fun shapes and some can be put together. I got 3" PVC and it works great for the guppies and gouramis that I have. I would bet bottom feeders will like it too when my tank becomes established. It does take a long time to put on the gravel if you want it to blend in with the environment, but it was well worth it to me. I like building things. I have an angle PVC and put it in the corner.
A warning on silicone. When it comes in a metal tube, the tube will bend and split very easily. It sucks when this happens, so always work from the bottom like toothpaste. My first tube had like 10 cracks in it and was a real pain. If your looking for a long project and enjoy building fishy stuff, I sugguest getting some PVC that your fish can swim through and deck it out.