Under settings, have the following option enabled:
- Create a new alias. Delete the old alias.
I had already created URL aliases for Users, changed the pattern, and updated. Nothing. Had to delete the existing User aliases and only then did Bulk Update work.