You don't. There are bounds on how much matter can be contained within your past light cone before it turns out you are simply in a black hole.

The number of possible past light cones that could originate from the same Big Bang using reasonable assumptions about QM is staggeringly large, but nevertheless, finite.