But you'll still use electricity - I suppose someone's going to pop up and say 'what about me I don't have electricity, but that number must be vanishingly small in the UK).
It might take a few months for your credit to be used up, but you'll benefit from it all the same. Just use the money you're not spending on electricity to help towards your oil costs.