I'll give my 2 pennies worth...
Saffron Walden is lovely. But, you have to drive to Audley End and pay for parking. The town itself is in the middle of nowhere and accessibility around the town is awful (traffic etc very bad). The schools are impossible to get into and County High is now unsustainably massive (and from what I understand, riding the crest of a reputation that may not match current conditions).
Whittlesford and the villages are ok, if that's what you want. But even Whittlesford, unless you live by the station (in which case quite a way out of the village) you will have to find your way their every morning (ie bike or drive).
Shelford is nice and we almost bought our very first house there, but we found it lacking in soul (but others may disagree).
I definitely wouldn't go to Linton, a total ballache to get to and from anywhere.
Truth be told we looked at every single possibility when we moved from a South Camb village, and, with schools being our top priority, we moved to Bishops's Stortford.
It's not to everyone's taste but I absolutely love it here