My mum.had me in her 40s (so younger than yourself but bare with me).
Life wasn't much different to my friend's whose parents were much younger than mine, I did know at primary school that my parents were old. Looking back they gave me a better more stable upbringing than my friends.
However, I'm now in my late 30's with 2 young kids, I've lost my father and my mum is nearing her 80s and is unable to offer much childcare, I am envious of my friends with grandparents in their 60s as they are physically able to support them.
Losing my dad in my 30s was horrible and yes I know you can go at any time, most people do live 60/70 plus years. I cannot imagine losing him in my teens or 20s - this could be a reality for your child.
IVF is brutal, you could fall first time, it could take many many tries. It took my over 3-years to get my daughter in my mid 30s.
As you've previously stated, your support network is limited so please think how your child will be supported when you are no longer here or as you age and need additional support.
I know how it feels to want a child so I do understand, but do think about what you will leave behind when you are no longer here.