I can't speak to his father, but in Tony's case... you know, he's not exactly good at people.

[Neither are most of them, though some of them fake it better.]

Especially not when he's trying to be nice.