Dh and I are both early 50s and looking to retire within the next 5 years. Other than not having enough money to live on (!) what other factors have negatively impacted your early retirement? Just want to be able to balance the positives.