Basically you aare looking to get orders from the court, which they aren't too keen on doing. However, if the court sees that it is for the good of the child then they can produce orders to stipulate where visitation must take place, also times etc.
With regards to the emails and him being an arse, I think your best bet is to ask your solicitor to write him a letter asking him to desist. Otherwise you are looking at criminal harassment charges or a restraining order, which unless he has been abusive you are unlikely to manage.
Personally I think you are being completely reasoonable about what you want.
HTH