I think if your communication styles are different and if he feels like you are able to outmanoeuvre him on an emotional level then maybe consider just really laying things out simply.
Let him know that sex is off the table when the kids are awake, sex is off the table when you've had a big dinner or you don't feel it on a Wednesday because that's a busy day or you don't feel up for it if you have been fighting (I'm just making stuff up now but you see what I mean) ..... say if he instigates sex during these times he may be rejected, not because you don't find him desirable but because you aren't feeling sexy at these times.
And list the circumstances that you do want to have sex ... When you've spent time together, when you feel appreciated, when you feel close to him. When you've carved the time out to spend in that way.... Maybe start off with that....
If you like early morning sex then add that in. I think you need to start communicating on a very clear , straightforward way because things are starting to spiral in a direction that isn't good. You need to pull it back to a much more respectful place, and quickly.