The observable universe is 930,000,000,000,000,000,000,000,000 m in diameter, and there's 13.7 billion years for such life to have come about. Keep in mind that:
A) That's just the OBSERVABLE universe. The Universe proper could be much, much larger.
B) That's excluding any form of sufficiently advanced aliens that can time travel from the future to the past.
If you think we're so special so as to be the only ones out there out of that HUGE amount of space-time, you're egotistical and insane.