I grew up without a father, from my toddler years onwards.
I have been perfectly happy and do not feel that I ever missed out.
I did see him sometimes, but hated having to see him, because he was a worthless idiot and an emotional manipulator rather like the man that you are unfortunate enough to be with.
You can choose to be a happy single mum, rather than being a miserable one with your baby's father.
Think. Would you want your child to ever be in the same position you are in now when she grows up?
If the answer is "no", then you shouldn't be in that position now either.
Also, and I strongly advise that you take note of this, when you split up with this man, do not be too eager to straight away find another partner.
You need time to become an independent, strong-minded woman, who can cope perfectly well on her own, before you begin another relationship.
As others have said, do not stay in this current relationship, letting your daughter grow up thinking that it's fine to be used like a doormat by a man.
Some of my favourite quotes from Pinterest:
"Choosing to be single isn't selfish. It's smarter to be alone than with the wrong person."
"No woman should be taught that love is how much sh*t you can take tolerate from a man."
"When someone treats you like an option, help them narrow their choices by removing yourself from the equation. It's that simple."
"If you're dating a guy who is a self-centred prick most of the time, but then reels you back in with his genuinely enjoyable side, you are not dating a guy. You are being held emotionally hostage by a selfish asshole with mood swings. Big difference, babe."
They've helped me in times when I've fallen for the wrong man!
Now, I've decided to just remain single, because that's when I'm happiest and muy true self is not compromised by anyone else.
All the best.