You are at risk of faecal incontinence when the sphincter muscles are damaged,. As you are a MH nurse you show evidence of having exceptionally low boundaries of acceptable human behaviour. You are not alone in this, I also know of psychiatrists who have very warped relationships. It does affect your Dd, it is delusional to think it doesn't.
Unfortunately the level of dysfunction that must exist before social services intervention is set to high. The other posters who have pointed out that your relationship meets this criteria are correct.
Child abuse is said to be occuring not only if they themselves are victims of rape or sexual coercion but when they hear it, witness it or are in a toxic environment where this is happening to someone they know.
You have no idea what your Dd has heard through the walls or through the doors, in the bedroom or in the bathroom, on the phone or in the hallway.
She won't tell you how scared she is for you because young children internalise fear.
You are absolutely deluded if you think you can carry on a relationship with a man that upsets and hurts her mummy so badly and brings him into her safe space her home.
It is utterly dispicably selfish behaviour on your behalf op but I feel sorry for you because you are so badly damaged yourself you have no idea what damage you are doing to yourself and your dd.
You will probably keep taking him back because your needs for warped attention and sex exceed those for self help and safe boundaries for your dd.
If these hard hitting posts actually help you to stay away from him permanently op then we have succeeded.
But I don't have any allusions.
Op, how about trying to be the best role model of a great mum you can possibly be to your dd as your primary goal for now and take a break from relationships from men while you work on this?
Good luck as you have brought your dd into the world and it is your duty to give her a safe, happy, nurturing and emotionally loving environment that you didn't have yourself.
Create it for yourself and your dd please, it's not too late 