Hi OP,
Like others, I think your weight gain is a red herring. Size 14 would be great for me. If you want to be a 12 you might not be entirely happy - however, it's a side issue.
The real issue is that your H seems incredibly cold and has given himself permission to say cruel and heartless things. That is the crux of the matter... for him to be able to say something so hurtful to you then it appears there is respect there, no care for your feelings.
It seems entirely appropriate that this hasa made you rethink everything, because this shows you exactly who he is. He is putting himself first, he is not trying to repair things and he is dismissing your needs completely. Not good.
I agree wholeheartedly with joysmum upthread, when she said...
He's prepared to ignore your needs for a good marriage and sex and closeness because his needs makes yours invisible.
In order for your needs of emotional and physical closeness to be met actually requires some effort and thought on his part and he's not willing to do that despite it being important to you.
You, on the other hand, initially cared enough about your partnership with him to take the effort to discover his problem and want to work through it.
In short, he is taking the piss if he thinks you should carry on as you are.
Where on earth does he think this leaves you? Has he thought about that? I think you should say to him that this means your marriage is over. He has effectively said that - but just saying 'I don't fancy you any more' is a pathetic coward's way out. It leaves you having to take the action of ending it, by presenting you with something that is unacceptable to you.
Lamely saying 'I just don't fancy you anymore' is like shitting on your Christmas present and giving it to you, saying 'Why don't you like it?'