Quite.
Op, I know thiis thread was written to help you make a decision about your future but there seems to be a complete disregard in your posts as to how much damage has been done to the people arround you.
You and your AP have been living in a bubble, dismantling other peoples realities and safety. Your last post shows you only seem to be hearing the words about compassion for yourself, you need to try to understand that you have been lacking in empathy.
For a start think about that poor woman whose marriage and life you invaded, you say he already left, but we know on here men only leave when there is someone to leave for, especially coming from a man who was not sure about the transition and who ultimately went back home, he knew you before he left her, you were friends, it's a coincidence that the relationship then started. If we know, then she most definitely did, wives are not stupid.
I suggest you do not speak of her in such degrading terms relating to her mental health because it quite apparent that your AP probably caused her ill health.
And your h, if you really wanted to help him with his depression and drinking do you think an affair was the best way. ?
I don't wish to further antagonise and berate you but you seem oblivious to anyones pain but your own and your ap's. If you go back home I can imagine you further blaming your h for your awful existance without AP, and he doesn't deserve that.
This woman's mental health was destroyed by what you both had done to her, she will never be the same, your pain in comparison is negligable, your dignity is still in tact, no one betrayed you.
And your husband, as much as you have painted a picture of him being abusive, if he were truly that bad there would be no way you would go back, you even suggested you pitied him, that is no basis to return home.
I personally would like in this scenario for you and the AP to be together as I think you have both behaved appallingly, I presume his wife is of a similar age, 50's, she must be devastated and her children must also be trying to recover from this awful episode.
It is this you should be pondering the hurt and devastation, not the neighbouhood or the increasing mortgage payments.