Apple trees: should I prevent early fruiting?

[Linguaphile]

I just planted a James Grieve in February (as a pollinator for my Cox Orange), and I have just noticed that it already has some small apples growing! Whilst I’m very pleased it is fruiting (presumably this means it is happy?), should I remove the fruit to encourage it to just work on growing and getting established this year?

Yes, I think that would be the best course of action. I doubt if the fruit would develop into anything edible so you're not really losing out on anything.