Kind of tangential, but I've always liked to think of memory as "predicting the past". I think we experience time in the direction that we do because it's easier to predict what's going to happen in the direction of less entropy. Given our current state, it's much easier to reconstruct what our state in the negative time direction must have been, as opposed to what our state in the positive time direction will be. Basically, our memory and our experience of time has a direction specifically because of entropy.