Sounds to me like he is just less comfortable in your familes company than with his friends.. Not too suprising.

Perhaps he cannot be himself in front of them? Perhaps he feels they look down on him?

I doubt it is anti social, and I would bet he feels bad about it too. But cannot bring himself to admit it to you.

Just my few thoughts..