You say that, but, if the universe has an infinite lifespan (as current models suggest) then we would almost certainly be Boltzmann brains. (There would be an infinite amount of Boltzmann brains, but only a finite number of humans)

I personally believe I am not, and the universe actually exists, rather than a sensory/memory ghost.