...it's the coal/fire.
We have a stove in the living room, and therefore coal (well, e-coal, as we're in a smoke control zone), dust, etc.
As a result, the walls round the stove (mid blue) are quite marked, and it does look like someone's been drawing on them.
I've tried vinegar, and normal cleaners, and nothing seems to budge them- any tips?