It’s not you ıt’s a “memory of you” and there will never be memory of “you” due to the fact that every memory represent past version of you as you said. Hence the world might be single but we look it perceive it with our own idea of it. We might perceive it similar but never the same