The reason it's possible is that it only loads as many points as pixels on your screen. So unlike our current system, it doesn't render the entire map at once. If there's a bunch of stuff in a house that you can't see inside, you won't render that stuff, because there is simply no need to.
It's the same idea as to why nobody bothered to go past 64bit color, you can't see more colors than that for the most part.
So since you can only see as much as the pixels on your screen, why render more?
It's a brilliant idea.