Your son is 4ish if he’s due to start school soon, what does he want to wear? How you feel about the shorts surely isn’t the issue. Does he want to wear gingham shorts or grey shorts?
personally unless my child felt very very strongly about wanting to wear something non-conforming I wouldn’t choose to put them in an item of clothing that’s going to make them deliberately the odd one out, but that’s my opinion.