Because we are being told that he is oh so clever, without the acknowledgement that a moneyed background oiled the wheels for him.
It's not possible to become an Eton scholar in the absence of considerable intellectual prowess. It simply is not.
In the old days, it was certainly possible to be an oppidan/non-scholar Etonian who wasn't very bright.