I am 56 and have Dd (15) and DS (7). I had him at 48. I was definitely not too old at 41 with DD - only slightly older than average in my circle - but I am probably too old for DS, mainly because he has ADHD and I am fat 😁. Also because many of our friends now have teens and older, making DS a bit of an outlier on group trips. That said, we have also made a different group of slightly younger friends with younger kids too, and that works well.
In some ways it keeps you young because you have to force yourself to keep going. However, you may also find you have less help than others because your parents don't have the energy to look after a small child, assuming they are even in the picture, of course. Mine had loads of energy for DD but really don't for DS.
I have a friend who had her DS at 45, and it has been fine for them, helped I think by the fact she and her husband were very financially secure. If we were financially secure, I would probably retire now so I could focus on the kids and I think if you may be able to do that or go part time, then go for it. If not, then it could be a challenge.
It's true what people say about the increased risk of problems, but having friends with a child with very complex needs, that is exhausting and a life long commitment at any age. The risks are reduced if you use donor eggs, of course, and perhaps that will be what you have to do anyway. Good luck whatever you decide