Oh poor you, and on your first time ebaying too. Sod's law. I know how you feel, I have been unlucky enough to have dealt with 2 really nasty people before, and though I was really pleasant and fair(and not in the wrong may I add!), I still got bad feed back. Some people are just arseholes fullstop.
I think you should definitely try and get someone to go with you...anyone. But if all else fails then definitely somewhere very public.
What's his feedback like, that should give you a tiny insight as to what he has been like to deal with previously. Though don't take it as gospel!
Hope it works out
x