I like how you're already jumping to the conclusion.
He didn't jump to a conclusion, you did.
You called him 'self conscious about yourself' (which is a really dumb redundant phrase. You can't be self conscious about someone else), and didn't explain how he was self conscious.
He was literally asking how you came to the conclusion that he is self conscious.