I really hope you are taking on board the advice.
Your frustration shines through the posts.
I imagine that you really want you child to have a good experience and also suspect you may need a break too. You are disappointed that it hasn't worked out again but please, please remember that you choose this providers to care for your boy. Presumably you did due diligence and would have left him with someone who you didn't feel was trustworthy. Neither will have taken this decision lightly. They are businesses and lost money for x amount of time. Why would they do that for nothing?
Your child may not have something that will end up with a lifelong label. Although honestly if you walked the walk many of us have you will end up so grateful that this was caught early and you need to really think you so resist to taking their advice. If someone with childcare experience said to you I think there is a problem would you really be saying 'well I don't.'. Your child clearly has a problem right now.....he can not settle into childcare provision. If that's all it is then he may simply not be ready and it's your choice whether to wait before trying again.
I say all this because we did move my daughter. Loads of people said we were daft to but it was the best thing by millions.
On reflection if she had babies then the CM wouldn't be able to tick your stated reason for socialisation.
Nursery could have been wrong for any number of reasons ....and sometimes valid.
Please though be very upfront with any provider including describing your frustrations as your son presents differently at home. Maybe have a longer settling in period, more initial visits if they will accommodate. Re visit the criteria you set when you looking at places and see if it was actually right on reflection.
Meanwhile explore with him sessional provision that you can go with him too.....tumble tots, swimming lessons etc and get him socialised.