You're not mad and you're certainly not too old! Nowhere near. I know women in their mid 40s who have just qualified. In my cohort the age range was between 18-45, with most being in their late 20s/30s.
You can get a student loan but it will be at a reduced rate. I also recommend joining studentmidwife.net - they've got lots of information on there about finances, access courses, how to write a personal statement and what being a student midwife is really like.
The drop-out rate is very high so unis like to see that you're committed. You don't necessarily have to get maternity related work experience as it's not easy to come by, but anything where you've worked with people or women/health related helps. Eg. women's aid, the samaritans, anything along those lines. You can even big up your office job - they like to hear about transferable skills and how what you've done can help in a career as a midwife. This shows that you actually understand what midwives really do and the reality of being one in the NHS today, as a surprising number don't. Read midwifery journals. Read as much as you can about being a midwife. One book a lot of prospective students read is Becoming a Midwife in the 21st Century - lots in there about the role of a midwife. (I can't stress this enough - admissions teams like to know that you understand the role of a midwife. And when you start your essays in 1st year they'll mostly be about - guess what - the role of a midwife!) There's also workshops dotted around the country run by independent midwives and others for prospective students. Would be worth going along to one of them.
As others have said, it's competitive all over the country for midwifery so don't let that put you off. Most unis have reserve lists and some people do drop out before the course starts for various reasons so even if you don't get an offer straight away but end up on the reserve list, you still have a chance! About half of my cohort came from the reserve list but be prepared that you might be called up to start at very short notice. I was very lucky and got an offer a couple of weeks after my interview, and I was surprised that a couple of people in my cohort came from the reserve list when one had been an MCA for years and the other was an HCA. I had no health care experience like that. Just goes to show that it's passion that is the key (the interviewer mentioned that I sounded very passionate at the time).
I really would recommend joining up to studentmidwife.net. You can chat to lots of others who are in the same boat. That forum was a lifeline for me when I was applying. Good luck!