Your impeller shaft may be damaged or warped. If you try the pump *alone* in a basin it should be totally silent. If not then it's damaged.
Now if it's silent you're good for glueing the impeller.
The little rubber cap wont come off easily, just make sure that:
* You dont lose it
* You dont bend the shaft while pulling hard
Thats all
Tell us if it went well.