He sounds a very damaged individual.
Does he take drugs at your home, is he using your space to indulge in things he cannot do at the hostel.
He is using you op, he clearly thinks he is physically better than you and you seem to believe him. It doesn't matter what he looks like, it's how he treats you and behaves that you need to take notice of.
This cannot last, if I were you I would actually move home, end the relationship and get as far away as possible from him and until you are totally free do not have your son with you full time.
He is a dangerous individual and you have invited him into your life, fuck the attraction and sex, you need to step up lady.
You are a mother and that must be your priority, you are failing your child, fuck looking after him.
You are being utterly selfish having this relationship (however crap he treats you) when your child needs you.
Move away from him, you know this will end badly.
You are infatuated with someone who does not give a shit about you, he is using you and it sounds like he's running out of people to use.
Your poor child.