Does anyone have any advice or experience with planting into gravel/rubble hard standing please? I'm not new to gardening but have never tried anything like this before 
The previous owner of my house landscaped the sloping front garden into a driveway (on the cheap!) by building a 4ft retaining wall a few feet away from the front window, filling it with builders' rubble to the same level as the footpath, and covering it with gravel. Not what I would have done, and the sodding gravel gets everywhere, but hey ho, it is what it is and I certainly can't afford to re-landscape it. Clearly the intention was to park on it but the council are repeatedly refusing permission to drop the kerb and in the meantime it is a weedy eyesore.
If I really can't use it as a drive, and I can't afford to strip the whole lot off and and turf it, would I have any luck in turning it into a Mediterranean gravel garden? I could probably dig out a trench around the walls and thought if I put in some topsoil, maybe lavender would grow? And would creeping thyme or rosemary grow between the stones on the rest? It's north facing but gets quite a few hours of afternoon sun. I don't mind doing a bit of hand weeding if the rest of it is looking a bit more intentional and less like a disaster zone! Any advice welcome, thanks in advance!