That's what it literally means, but whenever someone says that, they nearly always are also implying that it was a a significant amount of time ago. If it's not, then they might as well be about the same age
But 2 years is a relatively significant amount of time, a lot can change within 2 years.
Especially since the comment was literally that at 13 years old he did not like weed, but at some point within 2 years he tried it.
I don't see what's so ridiculous about that.