Here you go .
It sounds as if he is still attempting to control you. To an extent, he has the perfect tool with the dc, as he can claim to be 'involved' rather than interfering. It also sounds like he wants it all his own way...
Maybe you should think about having the free half an hour of advice that solicitors offer? It might make you feel better, as you'll know where you stand with regards to exp stating that he has to see your house etc (stand you ground there btw!).
If he doesn't get anywhere with trying to bully you (ie. you remain completely neutral and reasonable if possible) then he might back off. You are facilitating contact for him so he does not have grounds for complaint there really. Keep a diary of what contact you offer, and what his response is, so that you have a record of when he lets you down.
Hold on to the fact that you are doing the right thing for you and your dc. In a few months time, things could be very different .