Think about it like this, all that we observe from outside of our little blue dot is light coming from whatever's out there. That's why long exposure shots of the night sky seem so vivid and full, because the more time you have a camera fixed towards space, the more light is able to reach the lens and be recorded.
What we're observing isn't where it was when we see it, and objects really far from us that we observed have moved way, way farther from their original position than objects we observed closer to us.