I don't think it will. I suspect that many people watched it in spite of Greg(g) and because of him. Where possible, I have always fast forwarded to skip his bits. I'd watch more without hiim.
What really worries me is the BBC's building up these people that think are 'talent' and then giving them lots of airtime. I suspect if they had asked women in the building or done some wider research, as they should have, they would have found out that this guy is creepy as hell. Which makes me think some of people who are making the decisions are similarly creepy as hell.