The Doctor had never bothered to really understand Jack, he sees only the surface. It's sad because if he looked deeper he'd find the real Jack, the one behind the masks he wears, and I think he would be humbled by how much Jack truly cares.

Ianto is the only one who sees everything that Jack is, good and bad, and doesn't judge him.

Thank you!