Was it truly on a whim? Navigating contact can be extremely difficult, on top of all the complex issues that raising an adopted child brings with it.
The threshold for removing a child is incredibly high, so ordering legal enforcement of direct contact would be a minefield.
And as part of lots of adopter forums on social media, I know that the new push for direct contact is putting potential adopters off, which could lead to a shortage. People who have encountered loss themselves but have come through it and are ready to adopt, now being exploited as potential unpaid foster carers (im not talking about foster to adopt but direct contact in traditional adoption routes). Many abandoning training who would have made amazing parents.
For children who would benefit from regular direct contact, well surely you're talking about long term foster care being the best situation, not someone treated as an unpaid childminder until teenage years? Adopters are still people and deserve happiness themselves.
The safeguarding circumstances you talk about being almost an exception are commonplace- otherwise these children wouldn't be in the care system. I'm not anti contact by the way. I wanted to meet my son's birth mother and stay in touch via letterbox, wanted to explore direct contact with adopted half siblings. None of it worked out, despite my best efforts. We also had a birth son to factor in. Had direct contact with birth parents been mandatory in most circumstances, we just wouldn't have adopted.
I would have agreed to direct yearly contact under certain circumstances when we were going through matching. But most of our potential matches were with children whose birth families were so chaotic that it would have jeopardised the placement.