Exactly.
If yours is a home where there are books and enquiring minds, then he will be what he will be, which, in spite of his being "bright/advanced" may not be what you think/expect/want. He will be himself. And the vital thing is that he knows you value him for everything about him: intellect, kindness, personality, craft skills, imagination - whatever.
Having an expectation that he should be an "intellectual person" is as bad as having one that he should be an artisan and cutting off other opportunities.
We need people of all different sorts and above all else we need to value them for who they are; and your son must feel valued for who he chooses to become.
My OH was an intellectual and it brought him nothing but misery, as with it came expectations and pressures that fed his anxiety.
Your son is 4 - children develop in fits and starts and he may seem "advanced" now, but the others will catch up in their own good time.
Let him be a child; follow and foster his curiosity of course, but let him veg out, make a mess, be a child. It is a precious time when their greatest asset is their imagination, which can be killed stone dead by fact-filling. He will not thank you for taking that away from him - he will never get it back.
Chill, laugh and play. Forget the intellectual bit - at this stage it is not remot4ely important. It is not a race.