Being a rugged survivalist for 20 years does not simply loving go away when you lived in a community for 5 years.
And these people that killed him weren't living in the community, they were strangers.
So why would he just simply trust strangers like this? He wouldn't.
It's just a bad loving excuse to explain why he lost all his self awareness.
If armed strangers knew your name and are slowly reaching for their guns, you take your gun out and start blasting ASAP. You don't sit there asking how they know your name
This isn't like when John Wick got jumped. John Wick was inactive for 5 years but his wife died and was buried the day before he got jumped. He was also in a heavy state of depression. He actually wanted to die at one point because of the depression
The explanation for John Wick getting jumped is 1000x better than how Joel got jumped.