Haven't read the book. Have had a very difficult birth, not helped by an overworked registrar on a Saturday night, which ended in an emergency caesarian. Have only watched episode 1.
Adam Kay is very clearly depicted as a flawed human being, especially through Ben Whishaw's nuanced performance. He is irritable, quite arrogant, treats patients as though they're objects on a conveyor belt and is bullying towards the junior he should be helping to develop. We understand that he is under intense pressure, but nothing excuses boorish behaviour.
The overall impression is that Adam Kay would have been exactly the same, whatever his specialism. If he'd chosen to be a prostate specialist, we would have seen the same attitudes towards his male patients. He would have treated junior male colleagues just as he treats the lovely Shruti (see Lockhart's behaviour towards him).
His treatment of the "time waster" is patronising and - let's face it - negligent and he fully acknowledges this. Yes, he's tired, but the programme is clear that he has made an awful mistake, at least in part because of his character.
I might have an entirely different opinion if I'd read the book, but the TV adaptation suggests he has a misanthropic, rather than misogynist, streak.