Go for it Op.
DH uncle and wife were older parents, due to problems/miscarriages. They were almost 45 (mum) & 48 (dad) when their DD was born, she now 25, had a wonderful upbringing, definitely as good as other kids. I would say she kept them young at heart, they worked into their late sixties, were/are very active, she went uni. Her dad did a long distance Fundraising cycle ride with her and a friend and dad, when he was 63/64.
Yes, she was an only, but had a good friendship group growing up, her mums family are abroad but saw them regularly. In our family, she is only slightly older than my 2 DC and their 2 cousins, so they were like a gang of 5 whenever we had family get togethers.
For a second example, my own cousin has a toddler, born when she was 47.5, partner similar age. They didn’t meet until early 40s, he had been married before but no kids, she hadn’t. She did have a couple of miscarriages and it was a difficult pregnancy. She wrote an article last year (she lives abroad but is a journalist) and I was sent a link to it, very poignant, about how much their son has brought to their life. He is the first and much wanted grandchild on his dads side, has older cousins on mums side.
Both sets of grandparents are going strong in late 70s and 80s, cousin and partner have a full-on outdoor life, so no reason that they won’t live a long life too, but they both have loving siblings who would step in if needed.
Yes your DH will be a much older father than normal, but it sounds as if you are financially stable, he will be retired to look after the child and has had experience of young children through his career anyway. Teens may be another matter....but they are challenging at any age!