Gosh, I could have written your post, OP! We have/had almost exactly the same issue here - sloping, curved bed between a lower area of lawn and in our case a path adjacent to a patio of sorts, with huge rocks as a border 😉
We bought this property just over three years ago and the previous owners hadn't bothered with the half acre plus of garden at all and - although we had better things to do, the whole place being a renovation project - we immediately began planting 🙄
This area is close to our main entrance so fairly prominent and therefore we wanted it to look pretty. That first spring (2018) we bought loads of box balls/cones and alliums, planted them up and within a year virtually everything had died! At the end of 2019 we dug the lot out (although tbh we barely scratched the surface of the soil) and discovered the extent of builders rubble laying beneath the surface.
Ours is a 400 year old cottage - so not recent building work, lol, although a previous owner had sold the stone roof (😮😮😮) in the '90s, replacing it with slate so perhaps some of the spoil originated from then!
Anyway, we removed lots of brick, stone and other detritus and replanted with twenty-odd lavenders. Again, they all died!
This year we decided to do it properly - we've dug down to the level of the lawned area, removed a ton of (mainly) ground elder roots - the problem? and are currently in the process of sieving all the soil, mixing with well rotted manure and replacing the vast rock edging with oak sleepers. Then all fresh planting. The only things worth saving are some Solomon's Seal, a few daffodils, bluebells and day lilies. All roots will be washed off before replanting elsewhere.
I think this was the only way - starting completely from scratch and guess it'll be the same for you! If this doesn't work, I don't know what will, lol!
When ours is done I'll try to post some pics.....