You don’t necessarily need to be anchored in a hypothetical absolute position in space for there to be problems. Problems could arise if you just slightly move relative to Earth’s frame of reference. But yeah, you make a very good point! If you could travel through time while maintaining your position relative to Earth as easily as you can stay in your seat within an airplane, then it seems there would indeed be no problem.

Thanks for the insightful comment!