The fence at the bottom of our tiny garden is showing signs of wear and tear. Behind it is a v small patch of ivy (perhaps 40cm wide) and some dumped bricks and directly behind that is the neighbours extension. Am I right in thinking we can get rid of the fence altogether rather than replace it? Id like to clear up the area and hopefully paint the wall. The neighbour won't even be able to see the fence as there's no window that side of the extension.