If it's cylindrical and segmented, then yes, it's an oligochaete, and completely harmless. Indeed, according to some writers such worms are positively beneficial, keeping the sediment clean and promoting good biological filtration. See here:
http/www.wetwebmedia.com/ca/volume_7/volume_7_1/dsb.html
Cheers, Neale
Great article