Look the fact you can't be an integrated family living together speaks volumes.
I suspect your DH said he didn't want the children. Yes?
Why would your home not be 'calm' if you lived together as a married couple?
How old are your children?
Do they know you are married?
Do they ask why your husband isn't living with you all?
How do you manage to have a life together if you live separately? ie a sex life, meals as a family, outings etc?
I know of couples who are married or have partners and they keep their own homes, but it's always been a temporary plan till the children leave home or reach 18.
If you look at the bare facts of this:
- he's been married and divorced twice
-he has 4 children with 4 women but none was his wife
-he married you after a whirlwind romance (perhaps because you simply wanted to be
married and looked over his bad history of relationships.)
Your friends saw this, warned you, you took no notice so they have in fact washed their hands of you. That may not be right but it's understandable and perhaps tells us a lot about him if they have walked away from you.
IMO he doesn't sound remotely committed to you. Look at how he behaved about you keeping in touch with your ex. Look at how he wants to 'parent' a poor 15 yr old who is confused enough by her stupid mother, and now he's on the scene, trying to show he cares for a child who is likely not his.
This is a disaster.
If your self worth is so low that you can accept this 'marriage' and not know what you want, then at the very least get yourself to Relate or a private counsellor and talk this over with someone impartial.
You only have to read all the comments here to see how utterly awful HE seems and people cannot understand why you can't see that for yourself.
Have you ever had safe, unconditional love yourself, because you seem devoid of boundaries when it comes to men's behaviour.