Hi OP. I think you aren’t the one understanding, because you’ve grown up without the benefit of good relationships being modelled for you.
The reason this is so inappropriate is very clear to other people but not to you, so I will break it down.
You were friends with this man’s daughter when you were a young child.
He stepped in to help fill the void left by your not having parents, as a sort of father figure.
This means he saw you as a sort of daughter.
As a result, him having any sexual feelings towards you now should be as unthinkable to him as the thought of having sex with his own daughter.
The fact that he is clearly contemplating this is a sign that he doesn’t have good boundaries, and is willing to trample on boundaries that you should have and would have developed if you’d had a better upbringing. He would be massively taking advantage of your mental health problems and your drink issues in order to have sex with a vulnerable woman.
That is not the sort of person that any woman needs to be entangled with, let alone a vulnerable one with problems understanding healthy boundaries and relationships.
Please don’t do this. Your friend is more valuable to you than anything you would get from this despicable man.