You have changed the hot spot for only 1 frame of the animation and so it is jumping. Each frame can have hot spot in a different place.
You need to change the hot spot for all frames. You can do that in multiple ways. Either change frames one by one or (return the one changed hot spot to the original position) drag image in the preview window while it is animating - that will change the hot spots for all frames at once.