Thank you for clarifying all this, OP.
I think there's a lot more going on here than a house and your son.
I feel that you want rid of this house that has possibly been the source of anguish. You have done so well to pay off the debt.
Just be careful not to rush into something new, just to rid yourself of the house and it's memories. You can change how you feel about the house. Something new that appears to represent freedom, may be an illusion.
I also think you need to consider your children's futures. Including their immediate future. Your daughter is only 20 (I think you wrote). She is young, she may need to come home for a while at some point. Where would she go? Where is your son to live? What will you be able to leave to them (a long way off, I know). What happens if your relationship with your boyfriend doesn't work? Where will your children stay when they visit your and your partner? Do you not wish to have family time together with both your partner and your children at home? Do your children like your partner?
I could be way off here but I get a sense of panic and a wish to rush into the next phase and be released from money worry and what you perceive as the burden of this house.
I think you should really discuss all of this with a financial advisor - and close family and friends (not your boyfriend). I know your children are young adults but young adults still sometimes need the option of coming home, or at least a room with their family for a while.
I don't see anything in the way that your son is living that's any different to most 25 year olds. Of course he going to get take-away meals etc..
I don't know whether your partner is putting pressure on you to move in with him, sell your house (and in doing so, evict your child)., but if he is - please think very carefully; take your time, talk to friends and put yourself and your children first. Make sure you know your partner's financial circumstances, does he have any debt? If you do go 'all in' with your boyfriend financially, make sure your get a joint mortgage - and marry.
Good luck with it all, OP.