This is a dumb version of the Myth of Last Tuesday idea, which posits we don't *really* know our past existed, it's just something we infer from present circumstances. I personally like the idea that our pasts could branch from our choices, just like our futures (though of course we don't remember).