Sweetheart I am really sorry but this is a giant red flag.
The guy spotted someone who was vulnerable (single parent who had been through a bad relationship with a narcissist, younger) with a young child.
There is a strong possibility here that he has manipulated you so that you would get attached to him as your emotional support and he put on a good show to make you fall for him.
As other have said there is a strong possibility he is after your child.
None of what you described sounds normal or healthy.
Predators have a way to spot people who have been hurt in the past and know just how to push their buttons. They are always charming and supportive in the beginning.
End this now and focus on yourself and your kid and take time to heal before you even think of dating anyone else.
Maybe try to see if you can access some counselling to talk about relationships and spotting and avoiding unhealthy patterns.
I would also warn your circle of friends about this man and his behaviour.
Also don't beat yourself up for not spotting another Narc immediately.
I had a close male friend for 5 years who was charming, intelligent, generous, successful at work and kind. Then after 5 years I found out that all this time behind closed doors he had been physically and mentally abusing his ex-girlfriend. Nobody in my circle of friend spotted it until he also assaulted one of us and the mask finally came off. They are masters at hiding their true personality.