When I had shrimp in my tanks, they were quite brave and recognized my hand as the bringer of food. I typically avoided hoovering 'em up simply by swatting at them a couple times before letting the siphon go.
My shrimp always moved out of the way like my fish did. Have you tried it yet to see what their reaction will be? You may not have anything to worry about.