Well, of course we're not.
The stars we see at night are a crazily limited view of space--the atmosphere is in the way, and brighter stars make dimmer stars harder to see. Plus, each star can have at least one planet that could sustain life.
And these are just the close stars. Then consider there are different galaxies.
Get mah drift?