That’s the thing, society frowns on it, men with women young enough to be their child and in their early to mid twenties, and everyone thinks is a saddo sexual predator and the woman is after his money or has daddy issues. When women do it, they are perceived as some sad cougar trying to reclaim their youth, and the bloke has some weird fetish for older women. Very few people look at it positively.
It’s different if either party is thirties or older, then the age gap becomes less relevant, but when it’s someone in their early to mid twenties it’s seldom seen as something decent when the partner could be their mum.
There is also how do you fit into each other social circle, friends and family and the inevitable is that your son comments.
The fact you’re asking on here indicates what others think might be relevant to you and that possibly your social or work circle isn’t known for older people shagging young folks.
Also as you’ve been in a bad relationship are you sure you can have sex and not fall in love or want more? Becayse the over whelming odds are this lad will say what it takes to get laid, maybe a few times then move on to someone more his age.
If you’re comfortable with th fact the majority of people will judge, and the fact he will move on, then go for it, if either of these things could pose a problem to you then hesitate to go there.