Agree with this, it was our experience as well. BUT so much depends on the skill of the designer/installer. It is worth paying more for good advice. Heat pumps can be cheaper to run than gas or oil even in a not-that-well insulated house, but it depends on being able to heat with radiators mostly only at about 40 degrees, running for long hours. So the radiators need to be big enough.
-If your radiators and pipes are big enough
-If the heat pump is set up to adjust to the lowest temperature you need on that day
-If the heat pump is the right size
Then you can have a very comfortable system with low running costs.
A good installer will assess your house AND your existing pipes and radiators and tell you honestly what performance you could expect with what you have, what you would need to change to get better performance if it isn't ideal already (as it happened, ours only needed one new, larger radiator in the largest room, which had always been cold before anyway)
If you are in the South West I suggest you contact retrofit west. They use Heat Geek installer standards. And heat geek operate nationally and they do an option with a performance guarantee.
If you opt to cook with electric too you can also save the gas standing charge. (and stop getting pollution from gas burning in the kitchen, which is definitely a bonus for people with asthma)