@AnotherSadMIL
Why do you want a weekly dinner with just this child and spouse? Why not all together? And why weekly?
Why not do a monthly or quarterly big family meal? Or host the big occasions?
For us, we both work. We only have weekends together and to get things done. So if we were expected to spend every Sunday somewhere, that halves our time together and for jobs. Which makes life in general more stressful.
And now we have DD it would halve our time as a family.
DH drops into PILs most weekends for a couple hours, sometimes he leaves DD there for a bit so we can have a bit of a "date day" or get things done (or sometimes, just veg in front of the TV). Sometimes I go too if we have a quiet weekend and nothing needs doing. Sometimes none of us go.
My parents live further away, we see them around fortnightly, sometimes a bit longer between. They often come here for an afternoon, sometimes we go there for a couple of days (DD likes it better that way) but that does take up a whole weekend and sometimes annual leave and can then result in a lot of "catching up" in regular life.
They have a life of their own. It can't revolve around what you want. You have to fit into it however you can, and it will need to be on their terms or they won't be there when you actually need them.