sol's = solicitors? i'll presume so for now.
no, you won't look bad. but you will have to give good reason why you are saying no. and you will have to back it up as much as possible (ie: police reports/contact with police, GP visits, HV, anything, even if you kept track of his abuse.)
how do you know they already believe him? (who, for that matter?) the courts? your family? his family? you dont have to agree to going to a mediator. if you have NO plans of ever reconciling, do this thru proper court orders, is my advice. yes, it will be more trying and painful to face all this.
have you kept track of his phone harassment? when he called, what he said? if not, START now. it will be relavant.
i cant go into why/how i know about this, but i've had some personal experiences in the last year that taught me some stuff.
no, you are not likely to get an injuction against him if he's not actually hit you or your child. being on legal aid has NOTHING to do with you NOT being able to get an injuction. that is rubbish. i've known women at the refuge i stayed at who got injuctions while on legal aid. its a shame, but that is how it is. what you can do is talk to the police and get a panic alarm thing put on your phone (i believe its your phone, best to contact your local DV office at your local police.) i was not able to get an injuction as there was no physical violence. (unfortunately emotional/verbal is harder to prove )
keep up with the contact centre visits and talk to your solictor about making a contact order (it is an arranged, hopefully agreed upon visitation schedule.) you will have to go to court for this. what is the custody standing to? (do you have full custody?)
has he tried to challenge that? (if not, this could stand up in court if he tries for more contact, etc.)
dont lose hope and dont get disheartened. it can be a long hard struggle. you'll get there in the end and your child will know you as a sign of strength. hang in there...keep us informed.