OP - I work with victims of male violence. It is extremely, extremely, rare for men to be held on remand for threats to kill and coercive control.
Kindly, he must have normalised abuse for you if you think what happened wasn’t very serious but the courts think it is so serious he needs to be remanded in custody. It is also possible that he has previous for this which he either hasn’t told you about or has minimised.
I’m worried about you, OP. You need to seek support from a domestic abuse service and understand what he has been doing to you. He has manipulated you and normalised his behaviour to the point where you can’t even see what is really happening. This happens a lot, sadly. A previous poster suggested the freedom programme which might be a good idea.
As for prison visits, prisons are utterly grim places. Your child will be thoroughly searched (including having to open their mouths and their clothing searched) and go through multiple locked doors etc. The “family areas” I saw are just as grim but they put a bean bag or two in them and some colourful posters on the wall. It used to break my heart seeing kids going into them.
Don’t do it to your 2 year old. Especially as he is NOT a good father - good fathers do not abuse their children’s mothers and there is plenty of research showing that children who grow up seeing domestic abuse are often deeply damaged. You owe it to your child to keep her safe from that harm.
And you owe it to yourself to keep yourself safe too. Whatever he has said to you: “I’m only like this because you do this” or “It’s because I love you so much that I can’t help myself” or any of those sorts of things are nonsense. He knows what he is doing. I bet he’s done it before too (hence being on remand). I promise you that you deserve better, no matter how badly he has made you feel about yourself.
Good luck, OP. I wish you well.