That is exactly what my close friend said about the subway - she hated it and though when I first visited her at 16 years old (back in the 80s!) we did ride it a few times she did warn me it wasn't safe sometimes and we got taxis the other times - they're so cheap!
I mean people do ride the buses there etc but... they also walk lots too.
I lived there for a year when I was in my early 20s as I got a job with visa arranged and it was the chance of a lifetime but a year was enough.
Also, not everywhere or everyone has air con there, but most people do. It is bloody freezing in winter though, which is why most people take cabs... And it is stifling if you have to walk lots in summer. DC is worse in terms of humidity though, much worse...
Agreed with what @azimuth299 said, much as I hate subways, with a young kid, I'd be near a supermarket, subway and drugstore. All essential places with a young kid!
My friend's sister (creative, own business, 2 kids) lived in the Battery Park City area for ages (DH is a banker) and loved it for that, but moved out to another county (not naming where) over lockdown and I don't know if she's moved back yet, I think she kept the BPC house. She's a native of NY though who originally lived on Upper West Side.