if it's Victorian, it may well have lime plaster, which can be quite thick, so you would save a bit of room by hacking it off.
drill a few holes and see how deep you go before hitting brick.
As for the wall, some Victorian homes, especially after 1875, have a slate DPC, about two bricks above where ground level was when the house was built. It may be visible under or beside the front doorstep, or on the inside if you take out a couple of floorboards or look behind the skirting. It does not wear out and lasts at least 400 million years.
if there is no dpc, then I think the more brick that is exposed (so water can evaporate off it) inside and out, above ground level, the better. You may need to remove rubble or earth under the floor, and open airbricks. There is a thing called a "periscope vent" that is open above ground level outside, and channels airflow below the floor inside. Remove any plaster behind the skirting and space it off the bricks on battens to leave an air gap. On the outside there might be a cement plinth as an attempt to hide damp (it does not cure it)
On the outside, a trench filled with cobbles or pebbles (not gravel or grit) allows water to drain away, and large clean stones do not permit water to rise by capillarity.
Look for rainwater gullies and drains, which are often always cracked and leaking.
With luck the council will have a historic buildings preservation officer. If keen and well informed, s/he may know what methods have been successful in your area, and how to go about it. The may also be a local coven of the Victorian Society or other group.
This is an example of an insulated plasterboard. There is also a 27mm thick version. Some (not all) plasterers are skilled in its use. Electrical wiring should be run on the wall before fixing.