let him take you to court - get a good solicitor, keep records and offer supervised contact at a contact centre because of your concerns.
they seem to put an age of eight or nine for the child actually going to court - so she would not have to attend the hearing herself. but would have to be interviewed by cafacass but this i asusme can be done at home or at court family room.
the court will likely want cafcass to write a report with recommendations.
my oldest is concerned about seeing her dad my ex p (mental illness, violence, anger etc) but has accepted idea of a contact centre with another adult present. if you state you have concerns - but would accept supervised contact sessions so that professionals can view the situation then you are showing willingness.
however, in my case ex is refusing the contact centre offered (he is willing to do "anything" to see the chidlren -except cash in his £5000 premium bonds to put up the 700 for teh contact sessions --there are cafcass centres which are free of charge btw if ordered by the court....) and so they are not having contact at present.
still now sure how this will pan out with cafcass report. we have review hearing date end april.
first court hearing the (male) judge was very sympathetic to my views; second hearing famale judge was ready to discount my views! does depend on judge but if you have good solicitor they can make sure judge sees things... i certainly know what you mean by putting on the charm...