most car insurance seems to be very expensive unless you have some no claims discount - I think you were lucky there korma!
On the speeding - I doubt that a very new driver with any speeding fines would be able to get insurance at all TBH. That's just put the risk off the charts!
On all of this you have to balance with what people will put up with. So people are unlikely to be happy to go along for a battery of blood tests, go out on the road with a driving examiner for their insurance, that sort of thing.
Your idea about drinking is problematic with this insurance. For life insurance (eg), if you say you don't drink, and then die of something like liver chirrosis, and teh coroner links it to alcohol, then the insurance company don't have to pay. If a driver gets pissed and runs a load of people over - then the compensation (public liability (?)) does have to be paid. I'm pretty sure. So they couldn't say "aha you lied about your drinking habits so we're not paying" it wouldn't work.
For annuities you could use different things - but it would mean sending each pensioner for loads of medical tests and screening. You couldn't ask them the questions as lots of them would know what to say (sounding unhealthy would be key!) and you pay the annuity and you can't just stop when someone gets to say 80 and say "we thought you'd be dead by now that's what we based our sums on".
Thinking more you would have a situation where people were effectively rewarded for poor lifestyles - at a very literal and individual level. And poor miss bloggs the nun whose never smoked and exercised every day will get a pension of £1 a month because they expect her to live to £120. Actually I don't think that's very fair either.
So a lot of this is a balance. Moving too far towards a really personalised price seems actually quite unfair as it also penalises people for things they have no control over (eg genetic predisposition to breast cancer I think this already happens in medical underwriting) and also sometimes has the effect of "punishing" people for doing teh right thing 
I do think that there are new ways of pricing all the time and each time lots of questions are asked. The effect isn't always what you might want and these companies are there to make a profit, they're not there to be nice to people.
Personally I think that if you remove sex from motor premiums then logically you need to remove it from all ther others - I mean either its OK or it isn't, on principle. And if you're going to do that you need to understand what the consequences are in an industry that is not really on "our" side, they are there to make a buck.