You say you’re cutting out caffeine - what sort of caffeine: coke, sugary drinks, chocolate? If so, rather than a reaction to caffeine withdrawal, it could absolutely be hypoglycaemia.
As you’ve seen, low blood sugar can happen independently of an underlying condition. If your body is used to a lot of sugar and then there’s a very sudden drop, this can affect your blood sugar levels significantly.
People always talk about diabetes in relation to blood sugar but there are other conditions that affect insulin and blood sugar levels. My son was born with a very rare condition called hyperinsulinism, basically the opposite of diabetes - this causes severe hypoglycaemia without warning. I can pretty much guarantee you don’t have that as you wouldn’t have reached adulthood without being seriously ill at some point - untreated you’d likely have experienced coma, a stroke, possibly death, so I think we can cross that off! His symptoms as a baby were severe jittering (you could see his hands sort of bouncing and vibrating), lethargy, drowsiness. Hard to know what he felt like otherwise.
He outgrew that but now has Ketotic hypoglycaemia, aka accelerated starvation. It’s basically a sped up version of starving yourself, so he’d react like I would to 72 hours of not eating within 4-6 hours. This usually goes away by adolescence but I’m sure his consultant mentioned some adults developing it.
T2 diabetes can develop at any point so it could be that - it doesn’t only affect obese people, or those who consume tons of sugar, despite popular misconceptions
T1 diabetes is normally diagnosed in childhood but not always - it can develop in adulthood too. There’s is an autoimmune version that can start in adulthood (late onset autoimmune diabetes of adults, LADA) and other issues too: www.diabetes.org/diabetes-basics/symptoms/signs-and-symptoms-of-type-1_adults.html
You can go into most pharmacies and ask for a blood sugar check. I believe want this to be done at least two hours after food / drink (water is fine!). Or you can purchase a monitor to check yourself at home if this happens again, which would be really useful to know.
I’d see the doctor today personally, and I really hope you feel better soon 