She wrote at the time: "I was no longer Caroline Flack, TV presenter, I was Caroline Flack, Prince Harry’s bit of rough.
"Once the story got out, that was it. We had to stop seeing each other."
Anyone who reads her autobiography will see the same slur though. It's not a personal detail that can't be disproved. A slur that he obviously doesn't agree with.
I will reserve judgement until I read the book but I don't see how this is controversial in anyway.
He seems to speak nicely about her.