Like a PP said if something doesn't affect you directly it is easier to feel like it doesn't matter.
MOST would feel different about a comment like that if the woman and her dying baby were stood in front of them.
Certainly they wouldn't make disgusting and flippant remarks like the one above either.