To quote Chandler, 'my wallet's too small for my fifties and my diamond shoes are too tight...'.
You have a tax free windfall and will pay Capital Gains Tax only if your property windfall increases in value quite significantly - your Capital Gains Tax allowance and ability to offset sales fees etc will reduce any liability.
Governments budget to provide public services including hospitals, education and defence. Whatever the total cost, they need to raise a set amount of tax. If Inheritance Tax, or Capital Gains Tax is reduced or eliminated, they need to raise this sum elsewhere. Trying to target the super rich is notoriously unproductive. Easier targets are Income Tax, National Insurance and VAT. Increasing any or all of these risks disproportionately affecting those least able to pay, and in a country where many of the working people you refer to are reliant upon food banks to feed their children, does this seem fair? Or do you believe we should reduce spending on public services (which will hit hardest those unable to make private provision)?
Most of us like to think all our children are born with equal opportunities, but inherited wealth means irrespective of ability, hard work or character, children of wealthier parents routinely have significant material advantages. These advantages can follow them through life and maintain barriers to social mobility. Reducing or removing IHT and/or CGT would increase this inequality of opportunity further.
To declare my hand, I am in the extremely fortunate position of having assets which have increased in value over the past twenty years, but I cannot claim to have worked hard to earn this profit. I was lucky to buy when I did, and inflation has done the work. When I sell them, there will be a significant tax liability. My children will benefit from the remainder, and I truly hope they won't resent paying their share. There wouldn't be a violin small enough...