this sounds ridiculous but I don't know what to do. I'll start off by saying I have lived with cats on and off for last 30 years so am experienced cat wrangler 
I have two cats who mostly stay indoors but like a bit sniff about every day in our garden . The last few weeks have seen a small entire tom visiting which they didn't like one bit- lots of stands offs in the garden. After lots of enquiries and he wasn't claimed we trapped him & got him neutered. Have done this many times over the years with strays.
Kept him in shed overnight to recover and after a feed took him to a farm several miles away- know the people there and they are willing to let ferals & strays live in barn etc
10 days later he turns up at the back door again!!!! However he is becoming increasingly aggressive and our cats are frightened to go out. They aren't the only ones as he also goes for me each time I'm out and has made a mess of my legs as he launches himself at me clawing away. My legs are terrible this morning as even with jeans on he's shredded them! Bloody hurt I can tell you
We still have the trap but even though he's been obviously very hungry he won't go inside.
He's there all the time
HELP