I think some of the difference at least is that Gray has worked at it. Better, more polished material. Just compare the titles, even! And much better delivery.
The first thing on that godawful clip of Ives is them taking the mic & saying “how are ya” & smiling in a somewhat engaging way, introducing themselves... And then, for no comic payoff, barking “No!” at the audience.
I’m not even sure it was intentional - Ives cackled but nobody else did. Not a good start. it reminded me of the sort of thing my 8 year-old brother used to do on tape. (Though to be fair he could belch at will & often did so with good comic timing).
With Ives’ fans including a TV producer who said he’ll commission Ives just to own the Terves & the fabulist @DadJoke gets his tale from who deleted his - ahem - contradictory versions of what happened while saying he stands every word offering to buy people tickets, it’s not clear Ives is going to bother to put the work in. Why would you?
i was just watching Paul Merton talking about his first piece (the policeman on acid) and how he worked on it for months & got about 3 1/2 minutes of material. But it was brilliant, went over marvellously, he got invited back - and had to do it again because that was all the material he had.
That’s work. Ives is just a grifter.