Time travel like that can only go forward. If you want to go backward you need to decouple yourself from your relative position in spacetime. Or find a way to go faster than light without ever going light speed, which will definitely need a space ship.