Just thought I would add my bit of advice as I am a step parent to my husbands children. (their mother left them, we have been through court so many times so know the score)
Firstly, your idea of moving away without telling anyone is no the best idea as this will not look good on you if he did pursue anything in court.
It is also vital that you write everything down and put it on record.
I mean everything, if he let you down, if he changed plans, if he didn't give her back, if he threatned you etc etc etc. Dates and times. In court this will hold up in a feirce way.
The way a court decides contact of any children is through the childrens act. which has about 8 clauses in it....we dont have a solicitor and have won our case because I took time to read all up mnyself.
If you look up the childrens act 1989 and read each point that the court has to consider for contact.
There is the childs wishes (which would not be apprant in your case) the benefit of the child the distruption the the child, the capability to look after the child etc etc.
You need to study these point and give a reason for each one and supply evidence as to why contact is not a good idea. Normally if a contatc case goes to court first they will put forward a mediation meeting etc. You can either deny or accept, in my history we accepted first as it looks better, we then waited for her to not bother turning up etc etc. We then went back to court and used this as eveidence against her.
YOu can ask the court to consider an indirect contact order for the benefit of the child, in order to form a bond etc.
The court will not like it if you have purposly stopped any contact etc etc again this looks bad on you.
With regards to any physical violence insidence, who was there with you? It is his word againt yours and if you have an array of evidence to support his erractic behavoiur then you will look better in court.
You can also request that the court ask him to supply a timetable of his movements including any work commitments. You can explain the reason being that he has let you and youdd down and if you had a clear understanding of his schedule then he would have to stick to it etc etc if he doesn't the better for you again.
This may take time, but eventually you can ask the court put an order against him order 91 section (14) to prevent him going to court for any more contatc orders.
The court at first WILL expect you to agree some contact unless you have substantial evidence against him that it is not in the best interest of the child for him to have contact.
And finally....if he really is a bad bad bad influence on your child then it would be best for him to not have contact, however please never forget that if he is not that bad and the emotions are between you 2 only then you really need to condier the our dd. After all he is her dad and if you do go to court and have contact stopped there will be information for you dd to see when she gets older that you stopped her from seeing her dad....this may not go in your favour.
Please remember that just because she is not asking now does not mean that she will not get to school and notice all the other children have dads etc and not ask you about it because you will.
You need to be able to know in your heart of hearts that you really wwant to fight and it is the best interest of your dd. Our childre have now seen their mum for what she is....nothing. Where as if we had not allowed contact at all etc they they would not have seen their mum let them down. Hard lesson to learn but as long as your dd has your love she will always be ok. Please just make sure you can handle her asking you 'Where is my Daddy'.
I hope this helps and I apologise in advance if I have said anything that may have offended you. I do know my stuff as we went through 10 years of court,.....and represented oursleves as some solicitors jsut want to close the case and move on.
If you need any advice let me know more than happy to help!!!
I really hope it all works out for you