That is the problem with the idea that everyone has their own reality. This is not true in the aspect of closed time spaces I would say. It is only possible to have a different reality say if you are in a place that gravity is effects to such a large degree that it mess with time that is effecting your reality vs the larger reality of another gravitational pull.
It make sense is all on this is a general thought is all ok.
It makes sense