@Canadalife
Sorry, but YABU. To have a go at a man simply for calling you 'love' is ridiculous.
IMO, you made yourself look foolish, petty, and quite childish. I'm a bit embarrassed for you actually. 
You have to pick your battles in life. Some guy who lives by me was chatting to my DH (one day last week,) while he was trimming the bushes at the front, (and I was digging up dead bedding plants.)
He said 'got her trained in the garden now have ya? You've given up trying to get her to be good in the kitchen eh after she ruined your beans on toast by sticking the beans in the toaster with the bread?' 
I just said 'yep, just sandwiches and take out from now now! Can't trust ME in the kitchen!' He laughed. DH looked a bit embarrassed. 'Anyway hope you're keeping OK Alf!' I said, and just carried on digging my dead plants out. 'Aww, not bad luv' he said.
Deep down I was silently seething (even if the beans in the toaster comment was mildly funny!) However, this guy is 83, he has lived in our village for 75 years, and every one of the 400 inhabitants knows him, and looks up to him (even if he IS a cheeky slightly misogynistic fecker!) Also, he has a dozen relatives in the village.
He didn't mean anything nasty and is perfectly OK most of the time. The other week, he gave us a massive spider plant as it was too big for his kitchen apparently... He also gave me us lovely bunch of flowers when me and DH and the kids moved to this small village. Making us feel very welcome. He is not a bad man, he just says the 'wrong' thing now and again.
As I say, some things can niggle, but you have to pick your battles in life. I laughed his comments off, even though I found them annoying, and I told DH to not mention it to anyone either. It's just not worth it.
This guy would have forgotten the comments by the time he got inside his house. If I had made a massive issue of it, my name would be mud, and I would be shunned by people in the village for upsetting 'dear old Alf...'
You need to do the same. Pick your battles....... Yours was a battle not worth starting.