@Fammm Yeah you need to steer clear of this man. This is someone else's husband and you are clearly interested in him - even though you claim you are not. You deny fancying him, but it sounds like you do. Maybe you don't even realise you do, but it's kinda coming across like that.
Many married women have to tolerate women like you being over-friendly and flirty, and exchanging banter, and being 'playful' with their DH, and being good mates, and 'really friendly,' and quite frankly they do my fucking head in. They love to do it moreso when their wife is about, which I think is such shitty behaviour, and cruel towards the wife...
The men have to take responsibility for this too of course, and on some level I think they enjoy the attention/other women being friendly/seemingly interested. And more than anything, they enjoy the thought that they are making their wife jealous. Keeps her on her toes, makes her more thankful for him, and 'grateful' to have him (in his head!) and boosts his ego! But these 'over friendly' women need to step back and stop flirting with married men.
Steer clear of him, stop the banter, stop the flirting, and quit the 'talking bollocks endlessly' with him. It's not fair on his wife, and no matter what you say, you ARE loving it. And so is he. More than anything, he is not YOUR husband, so stop acting like he is, and that your behaviour is not a problem.
His poor wife. 
As far as I can see on this thread, the only ones who support you are the ones who very likely engage in this behaviour themselves. Seriously, get your own man, and leave other womens men alone.