do think if my instructor is pointing in the other direction as I pass speed limit sign then he should be made aware that it causes situations like this.
Unfortunately, that's just part of driving - you have to multitask. Even with no one else in the car, you might be looking for a roadside or house number, and still have to be aware of the current speed limit. You have to be ready for potential hazards - a child running into the road, another car doing an unexpected manoeuvre, veering onto your side of the road, things like that. And while bearing all that in mind, you need to be thinking about whether you're in the right gear, needing to slow down, to signal, etc. And you could have the added challenge of having squabbling kids or a barking dog or chattering friends or someone else in the car, who are purely distractions, not trying to help you improve as a driving instructor should be.
It gets easier - I don't have to consciously think about gear changing in the way I did when I was learning, and that's just down to years and several thousand miles of driving experience. But you do have to be aware at all times.
Anyway, the speed awareness course is interesting and well worth doing. I recently had to do a motirway awareness course, and made me aware that it's probably useful that learners can now go on motorways in certain circumstances, because otherwise, passing your test round urban roads mostly at 30mph or less is enough to allow you on a motorway.
Go and enjoy it - it's better than points.