God, all the time. I'd say far more often I get off feeling frustrated about our achievements/rate of progress than I do feeling fully satisfied (partially to do with my self-critical personality though!). Right now my mare seems to be regressing and doing some odd things (humping/bucking) which I'm convinced is to do with some kind of underlying physical issue whereas my instructor is sure it's just behavioural, so I have that confusion/guilt element added in, I've ended more than one session in tears this month and she's currently on the easy list pending investigations!
With your boy, am I right in thinking this is a relatively new ride for you? If so I wouldn't be too hard on yourself, it certainly sounds as though nothing terrible happened despite all the chaos around you, and even if you didn't achieve your aim then you made progress on your relationship with and knowledge of the horse.
Apologies if this is very wide of the mark but it sounds as though you are being quite gentle/cautious with him (e.g. you mention jumping off and reverting to ground work when he turned spooky/tense) - this is absolutely fine and sensible given the circumstances, but it might be worth thinking through the fact that sometimes with horses, things have to get a bit worse before they get better, or in other words if you fix one problem another pops up. Sometimes you just have to persist and keep asking the question despite not getting exactly the answer you were after. So for instance my mare's big issue is tension, when eventually she softens and relaxes as asked, she will tend to drop behind the leg and lose impulsion. When sent forward again she will immediately tense and stress and feels like we're back to square 1. But I do just have to keep on correcting her, over and over sometimes, until she gets what I'm asking for, even to a small degree. Then the next session, repeat the whole process again until she remembers....also ironically enough I've found (when she's not broken) that spending some time on things which particularly stress her (like canter transitions) actually help, because then when we return to things she finds easier she's more relaxed, like she's relived she can actually do what I want!
So do try not to get disheartened if you don't make linear progress is what I'm trying to say, it doesn't really work like that! As you get more confident in him, don't be afraid to push him (and yourself!) a bit to find out what your limits are, you may be surprised. Good luck