As one of 5 siblings all married, ime sometimes, for whatever reason some inlaws just won't get on. My mum/dad had 5 SIL/DIL, got on great with 2 DIL and 2 SIL who were all very different types of people but everyone accepted each other as they found them and got on well, never in each others pockets but had fun when we did meet up. My siblings got on with their spouses family too.
Then there was one SIL where it all went wrong. Suddenly my family were accused of being unwelcoming, standoff-ish, not close like her family, and "up our own arses" 🤦🏻♀️. Mum/Dad were at a bit of a loss as they didn't (initially) think of or treat her any different to the others they (believe they) warmly welcomed but for whatever reason both parties didn't gel and over time the relationship just petered off to LC, which was probably best all around. Mum/dad missed their son so much, but didnt say much about it and invited/looked forward to occasional visits and tried to keep a low profile, terrified not to rock what seemed like a very sensitive boat. SIL would tell anyone who listened that it was delibrate exclusion from day 1. They felt they just couldnt do right for doing wrong. Being in the area and not visiting is something they might have done as they didnt know how dropping in would work out. 🤷🏻♀️
30 years on I think she just had high expectations of having a very close relationship and needed constant validation and we were the exact opposite and it was just an untenable incompatitibily. We now see them together once a year and it is awkward, always on her terms and we do it just to keep in touch.
Not saying yours if the same situation op, but whatever the reason for your poor relationship with your inlaws they are your dhs family, encourage him to visit them himself if he wants to and if you cant face it then dont go.