What if past changes all the time, as much as the present and as the future do?
You can remember now what happened yesterday, for example. How can you be sure that that is what happened?
I haven't watched the Dr. Who series, but I know the premise.
Imagine that time isn't one-dimensional, and flows in one direction only, but that time is multi-dimensional. You can experience it flowing, with various speeds, forward, backward, and also in many other directions that are the probabilities resulting form the different choices made in each moment. Imagine also, that whatever action you take this moment propagates instantaneously in all directions. The apparent cause of a current effect is created backwards in time. It wasn't there.