That's it really.
I've picked off as much as I can, but there's still many little bits stuck to the bricks. I've tried soaking in warm water which didn't help at all (just made them more smeary).
Is there anything that's going to make the job easier?