Happy Birthday Pumpkin(winner)

I am genuinely sorry to hear what has happened; and I'll bet you expected more for your birthday (and had a right to).
I won't make any assumptions whether splitting or trying again is the right thing to do. That is not my place nor the place of any other poster.
I would point out however that your love and appreciation for your DH does shine out from your initial post (at least to me) and there is no wonder you feel bereft.
What happens next is up to you; take some time to think it through in your own head, bearing in mind that the posters here will all project their own experiences into their answers - ranging from the "LTB, all men are deceitful bastards we are happier without" posters to the likes of me who have made mistakes in their lives and marriages, have (massive) flaws so can understand (but not condone) your husband's behaviour - so are probably biased the other way.
In my first (failed) business venture I ran up a lot of debt. My wife knew about most of it but not all.
I am prepared to be flamed for this but I did not lie to her as such - it was lies by omission. The reason? Well, it was hard to admit that something which had started so well and she had been a great support for had started to crash around me so dramatically.
Like a gambler I thought just one more job, one more month and things will get back on track and she'll never know what a fuck up I've been for the last 6-12 months.
The break through moment for me was dropping my daughter off at school one day. I felt so low and watching her skip into the classroom so happy meant an overwhelming sense of failure - to provide for her, my son and my wife - gripped me and I struggled to contain myself on the walk back to the car where I broke.
That day I started reaching out to people I knew and within a couple of weeks had some well paid contracting work.
I had to close the office, make people redundant, let go of being the boss and do work I really did not want to, but it meant I was able to repay the debts in full and put myself back into the position where I could have another go (albeit with the benefit of the experience of failure).
When my wife asked why I had made the sudden decision to close the business I told her I had always promised I would stop if our life, house etc was threatened and that time had come.
I had to ask her to lend me some money to cover the last bills (wages etc).
Did I tell her just how much I was in debt? No
Did she ask? No
Did I lie? Definitely by omission
I lied because I did not want her to think of me the way I thought of myself - as a failure.
Did I do any of it not caring about the consequences or thinking she should/would just accept it and help bail me out? Definitely not.
The male ego is an odd thing when it comes to being a provider. It's one thing I would see as a massive insult if someone questioned it. (Someone used the big car/small dick insult once in a parking row and I could only laugh. If they'd told me I was lazy and did not work hard they'd have hit a button)
That does not make it right, it does not mean I would feel emasculated if my wife earned more. It just means I can understand where your DH may have been.
Only you know whether you should keep going or even if you want to.
All I would say is there are ways he can repay the debts and make amends without you having to actually bail him out.
He can get a job. Get a loan to consolidate the card and pay it off over a manageable period from his own wages and contribute to the household and any new childcare/housekeeping commitments.
If he is willing to do these my argument would be positive towards him. If not, he probably is a self centred twat who does not care how his actions affect the rest of you.
My sincere best wishes for whatever you decide to do (apologies for the self indulgent length of the post though)