Have name changed as this is clearly pathetic, but I'm feeling SO envious of Jools and Jamie Oliver
You are not pathetic! If you don't allow yourself to feel your feelings, it will be all the more painful for you 
I look at the pics of them with their five children, brimming with happiness, and my heart just aches
They seem happy and I hope they really are, but happy-looking celebs break up every day. I am not wishing that for them, of course not (in case it came across that way). What I am saying is, in today's Facebook/social media world a lot of people feel that others have got it all. When the reality is we all face problems at the end of the day - illness, death of loved ones, accidents, disappointments. No-one escapes this.
I am 39, my husband has male factor infertility, we've tried IVF. It just isn't happening
I am so sorry. Like others have said have you explored every avenue yet? I can't advise as I have no experience of this. Leave no stone unturned yet.
I imagine their house full of laughter and joy and Christmases and birthdays
Everyone's house has the potential to be like this, even without children. Mine is and I have no children.
Our house is so quiet
I don't want to seem obtuse. I know you meant quiet without children. I don't want to seem flippant either. I am afraid of saying the wrong thing and making it worse, but I have no children either and I've always had pets. We currently have the most adorable dog and I don't know what quiet is anymore. He's a real live-wire and I can't imagine life within him now. Every day I have to get up for him. Do stuff for him.
Once you have tried everything else, please don't write off the comfort and joy pets can bring. I know it's not the same if you are maternal, but it's somewhere for all the love you have to go.
I'm tearing up as I write this, but I know it's pathetic
Please don't be so hard on yourself. You have every right to feel cheated and angry and upset.
OP, you may find the following website comforting and of practical use. It was set up by Jody Day who has faced the same issues as yourself. She has a book out and there are meet-ups you can go to, etc. There are blogs on there about every aspect of this - including the very thing you have posted about now.
http://gateway-women.com
I am sorry that you are feeling this way. It must be so incredibly painful. Is your husband supportive and understanding? Don't give up hope yet - as PPs have mentioned there is other stuff still to try.
Otherwise, you need to find a way to make your life work despite this. Try to stay away from articles about the Olivers and people like them. It's rubbing salt in the wound right now. 