It's not uncommon for the female libido to take a dive after giving birth and it may not return to its former giddy heights for many months after the event but, if you resumed your sex life without physical discomfort some weeks ago, it would seem that other issues are causing you to reject your dh outside as well as inside the bedroom, so to speak.
Giving birth is a life-changing experience which can cause some to ponder matters they rarely paid attention to before the advent of a pfb, and various subjects may have come to the forefront of your mind which you haven't previously paid much heed to.
Charting the milestones of our dc is a surefire way to focus attention on the passing of time and it's not unnatural to relate that to our own passage through the years, which suddenly appear to fly by until it seems that our youth was gone in little more than the blink of an eye.
You may be feeling overwhelmed by your recently acquired persona of a 'mum' - a being that you may believe is aeons away from the young, slim, and carefree woman you were, and that you fear you cannot become again in this lifetime.
In terms of being abe to please ourselves to the exclusion of any other consideration, the arrival of dc put an end to 'carefree' until such time as they've flown the nest and beyond but at 32, you are still young - and will remain young for as long as there are folk around who are older than you 
As for 'slim', that is a state of mind as much as a physical shape. Many women of your age consider themselves slim at size 14/16/18 but, by paying attention to diet and exercise, there's no reason to suppose that you won't attain your pre-pgy weight if that is what you want.
Your dh obviously adores you and is no doubt longing to revel in your temporary voluptuousness; and rightly so because your womanly curves are testimony to you having brought his dc into the world.
Perhaps later today you can unearth your make-up bag, whack some slap on, pop dc in the pram/buggy, and take a hike around your locality?
And maybe tonight you can sit on the sofa with your dh, hold his hand, look into his eyes, and find the words to help him understand that post-pgy hormones can play havoc with the mind and body and that although at the moment you cannot express your love for him sexually with any degree of enthusiasm, this doesn't mean he is no longer the love of your life.