You are not being pathetic. He has no reason to hate you. If there was a problem with the marriage he should have talked to you about it, not just bottled it all up and then bolted.
If I were him I would be feeling guilty and trying to make you feel better by understanding your situation and fitting in with you.
Mind you some people cannot cope with feeling guilty and just fall into the blame game.
Personally I think that 11 to 11 or 6.30 to 6.30 is totally reasonable. I dont think you are punishing him, I think that he is trying to punish you because he feels to bad.
The man needs to see sense!
Sorry I feel rather cross about the way he's treating you. I wish he could see that the way he is behaving is completely counter-productive. The more he behaves like a nutter and tries to get into your house etc, the less likely you are to want him to spend long periods in sole charge of your daughter!
Anyway the fact that you are morally right and behaving far more maturely than him is one thing. But I can see that you are going to have to work with him no matter what.
Is there a compromise that can be had out of this situation, eg he can have her for two shorter periods (maybe of 18 hours) rather than 1 x 36 hours?
Would he agree to have an external mediator look at the case? I think there is a service, maybe if you rang the CAB they could advise.
Hang in there Wirral I am sure in a year's time this will all seem like a bad memory. Don't be scared of the future the only way is up from here....