All sorts of things wrong with what he's doing - and I don't want to trivialise his behaviour, but it's been fairly well covered by posts above. I'm also not having a go at you, just suggesting that maybe you need to have a think about your own attitude to this - apologies if this comes across in the wrong way, it's intended as being constructive.
I speak as the man in a relationship where my wife isn't interested in sex. Given Bluepetticoat's response to saddadgladdad above, I feel the need to point out that I've never forced myself on DW, "messed around" with her, or even pestered her for sex (sometimes I wonder whether things might have been better if I had pestered - maybe I'd at least have got the once a week to "shut me up"). We never had sex whilst DW was pregnant - TBH we've barely had sex since DW first became pregnant. I've always considered that if DW didn't want sex when pregnant that wasn't totally unreasonable of her (though seeing comments from others on here since I joined, it seems most women do quite happily have sex occasionally - and it makes me a little bit sad that it's something I'll never experience).
Anyway, the comment I was picking up on (in combination with everything else) was "We want 4 or 5 kids." - for a start is that definitely a "we", not an "I"? So the big question is if you're not actually ever interested in having sex with your husband, do you just see him as a sperm donor, and then a father to your children? What is the point of your relationship as far as you're concerned? Apologies again if that comes across the wrong way - just that it's a thought I've had about my own situation given that we have 2 children despite only having sex once since the first was conceived until the smallest was almost 3.
I don't know - your relationship seems totally different to mine, as your DH can hardly complain he isn't getting any, and I'm probably just busy hijacking because I'm nervous about starting my own new thread (though I suspect your attitude to sex is pretty similar to that of my DW - just that your husband pesters more than I do and you have an attitude of duty to it). But I wonder where you'll get if as suggested you do own up to your true feelings to him and suggest that you never want to have sex. Oh and I agree with TooEasilyTempted's concern about your "beds to be slept in" comment.