I was a SAHM for 20 years (from first maternity leave). I absolutely loved it. I loved being able to be there for my children whenever they needed me. I (think) I had very varied days, I was never bored. Lots of different friends, gym, cooking classes, language lessons, volunteering, etc. I know I was very lucky to be able to do that.
However, 21 years later, I am now divorced. My choice entirely, but I really never saw it coming. I'm working PT but am feeling increasingly useless and worthless because I know that I'm capable of more, yet I have no relevant or recent experience. I've never even worked in an office with a computer!
Would I change anything? My time at home with my children was the most precious time to me, but now they resent that their dad, by law, has to give me maintenance and they have no appreciation of that I gave up a very good career for them. (again, it was my choice, but has rendered me more useless than a good graduate)
If I was you, I would keep one finger in the pie in one way or another, so to speak. You never know where you'll end up...