Good God - where does the time go? 
.
I think it's difficult and sometime inaccurate to compare labours with and without epidurals because in the vast majority of cases epidurals are used in first labours which are inherently the ones that are longer, more difficult and more likely to end up with a CS or forceps. So the side effects are higher too IYSWIM.
So, epidurals. The facts are:
1 in 10 don't work the way we want. So, they don't work at all, work on one side or miss out a bit.
1 in 100 can cause a post-dural puncture headache. A sometimes incapacitating headache that can last a few days and make you able only to lie flat when you're meant to be looking after a newborn. Not dangerous, but traumatic.
The terrifying nerve damage side-effects (the worst being paraplegia) are hen's teeth and IMO not worth even thinking about. But they do exist.
Also, they can cause transient low blood pressure and make you feel shit, or even distress the baby a bit. They can slow down labour and result in an increased likelihood of needing a hand at the end.
BUT (and this bit is partly my opinion)
When they work they are AMAZING. They are usually not hard to put in, and within a few minutes you can be pain-free. Labours, especially the first one, are often long and exhausting.
I've seen hundreds of women go from distressed to smiling (or more often asleep!) in half an hour. The serious side-effects are rare. I think that if your expectations are realistic (bearing in mind the ones that don't work perfectly) they are a fabulous choice.
However, OP, I still don't think it's the right thing for you, if you have another fast labour. If it's a slower one, however..... 
.