Make sure it's not actually the thrust bearing moving in the case...you'll need the flywheel off to see...
Push the pulley towards the flywheel end, then watching the bearing, pull it back... If the bearing doesn't move then try pushing it back into the case
No movement = win
Bearing moving =...