How much is the house bothering you? Is it filth or just lived in mess? I'd say set aside half an hour before bed to tidy up and half an hour in the morning to straighten up. There's no reason to deprive yourself of the you time that you find relaxing.
I haven't slept properly for 6 and a half years. My chdren sleep pretty well - but I've got into a routine of having 'me time' when I go to bed ... in front of the television, iPhone, Nintendo, etc. I wake up at about 5am every day and am on my phone checking Facebook. My house is a mess... and I know what I ought to do! Switch it all off and get up early to sort the house out.