As far as I know you can't rotate bumpmaps. You can use heightmaps, I believe. Or, turn rotation off for your object.
If you can't turn rotation off for whatever reason then make your physics object invisible, then have your bumpmap as a separate object and "Always -> Set position to another object (physicsball)"
Or something like that.
Edit: Heh, beat Rich by mere milliseconds