Major problem with time travel

Movies that feature time travel or even the general conception of the idea is like this: You retain your position in space and travel through time to appear at the same place in future or past. Here is my problem, did nobody else foresee this? If you go back in time and conserve your momentum( seems like a must) to appear at the same place, you will most likely end up in empty space or in a star because the earth, solar system, milky way galaxy fucking moves in space. With our current momentum we can't match Earth's motion through space and all travelers will die in vain.
Jumping in your DeLorean and appearing at the same place in future huh? No, you will drift in space with 85 miles per hour to eternity.

Moving with speed of light would require infinitive amount of energy, so you can't move with speed of light, so you can't move with speed faster than speed of light, so you can't travel back in time. How american one have to be to believe in time travel.