I mostly do, and sometimes associate the person with the icon. There are a few who change it almost daily though, and it gets a little remembering a user tied to a multitude of pictures.
I've had mine since December of 2013 i believe, so anyone from that point on should recognize me, and if they don't, then that makes me really sad :'(