I know this isn’t exactly the point but... the fishing is doing my head in. Since OP hasn’t clearly stated this but people are making assumptions, he IS bringing home or taking selfies with some type of nighttime fish, OP? It seems strange to me that, unless he’s interested only in carp, which is possible, but even then, that he only goes on the same day of the week, regardless of the weather, temperature, etc. I mean, fish aren’t going, “Oh blimey! Wednesday night, lads! Mr. OP is going to be here, so time to bite!”
He must have a shitload of nights that nothing happens if he just fishes every single Wednesday night.
But whether it was golf, cycling, fishing, or basket-weaving, no, it’s not acceptable for him to act like you deserve no break and he deserves four days a week off, and for him to want no time with his family.
If he won’t talk about it, then there’s nowhere much to go. Maybe try waking him up with some of the hour calculations you’ve seen on this thread. Don’t SHOW them to him - just say, “you work X hours, fish X hours, sleep X hours, and only see us X hours. I take care of the kids X hours and only have X hours to myself a week. I don’t want to continue like this,” or something.