English Heritage did some studies on ivy on brickwork and found, contrary to common belief, it doesn't damage brickwork. In fact, it was found to be protective to houses and efficient in thermo-regulation, keeping buildings cooler in the summer & warmer in the winter.
Visually, the ivy needs a trim but I like it. Better for the environment, good for energy consumption & living environment and doesn't harm the masonry.