It does sound like it has to do with the impeller.
However, although it may be going bad, it may be a couple of other things, namely...
* There could be a grain of something, or a snail shell in there. This will most likely cause a serious grinding noise.
* It could be a trapped air bubble (fairly common when first setting one up). This causes a lighter grinding, almost a "gargling" noise.
* The impeller may just be incorrectly seated.