Why is this?
If you have reservations you think it through, give it a bit of time, and then go if it is not working out.
Why do people stress about this?
I do realise that children and debts, mortgages and all the rest of it come in to play, but they will still be there if you stay or leave.