OP, There is nothing silly about your post.
You are in an abusive relationship.
Your husband is selfish.
Your husband is controlling.
Your husband gaslights you.
But you know this.
He only cares about himself.
I bet he's a sulker.
I bet everything has to be his way.
I bet you humour him a lot.
No wonder you like your days away from him.
You are being abused by a nasty little man who only cares for himself.
You need to take a good hard look at your life.
You need to decide is this really what you want.
You need to protect yourself.
You need to protect your children.
Absolutely NO PERSON who genuinely cared for you would deprive you of your sleep.
It's so basic in a healthy relationship.
That's why abusers sleep deprived their victims.
To keep them weak and off balance.
Protect yourself.
He is a Nasty Vicious Abuser.
Wake up and protect yourself.
Look for support IRL.
💐💐💐