Bear in mind that electricity bills are subject to much higher levies than gas - despite electricity in the UK being much less carbon intensive than gas (because renewables and nuclear make up the majority of generation). So the government plans to move some of the electricity levies gradually over the gas.
So the difference in cost will narrow over time.
I have an air source heat pump - mid 1980s compact 2 bed terrace with small back yard. I have replaced the crappy single glazing with double but would have done that anyway.
This is my first winter with it, having replaced gas, and it has done really well. You do need to engage with it and learn how to run them - it's not like a a gas boiler. But my house is a very toasty 21C right now at 10pm while it is 3C outside, and my entire energy bill today so far is £3.20 and that includes running the dishwasher and boiling something on the hob.
Water cylinder got squeezed in the loft space. You can also get options like Sunamp heat batteries which fit under a kitchen worktop.
I've also now got solar - just a few panels - but I set it to heat the water cylinder whenever the sun is out so it is done for free. You can't do that with gas!
Only downside is the heat pump is a bit ugly, like an air con unit. You can get vinyl wraps in the colour of your wall/fence and then they blend in a bit more.
No, they aren't for everyone but a well designed, correctly installed one can work really well, even during the cold spell back in Dec.