Please don't minimise his bloody awful 'comments' OP, stick with what your instinct is already telling you, that you'll never be able to forget what he's said and 1. how it made you feel, and 2. how it made you see him.
You know that he's not sorry about making the remarks, he's just upset that you are 'reacting' to him doing so?
If he actually cared about your feelings, he'd never have made either one of his offensive jibes, would he??
It just smacks of him either 'dropping his guard' accidentally before his brain caught up with his mouth, or of him purposefully trying to make you 'jealous' and worried about losing him?
Neither one of these reasons is good. They're both insulting and offensive.
I'm with your gut OP, this relationship is over for you, as there's just no excusing his remarks. He'll never, ever look the same to you again no matter how many times he 'apologises' or tries to excuse his remarks.
What's done, is done, period.
Extricating yourself won't take long as you're not married, living together or sharing finances, so it'll likely be a lot quicker and easier than you think.
It'll certainly be better than staying and keeping the 'relationship' limping along, knowing every day how he really feels while pretending you don't?