No, what you are missing re advisory/binding is that the referendum act DIDN'T state the result was binding. That is why it was not binding.
And it is nothing to do with remainders/leavers. If remain had won the referendum would still not be binding, leaving could still go through parliament (as it could have done at any time since statute brought us in after the last referendum).
The fact is we are in by statute, referendum or not referendum, referendum saying leave or referendum saying stay, ultimately we are in through parliament (statute) and coming out at any time referendum or not has to go through parliament.
Part of the problem is people thinking the referendum (irrespective of the result) means that is it we are done now it is decided and finished.
It was a parliamentary decision to go in, it is and always has been a parliamentary decision to come out, and TBF one that could have been made at any time referendum or not.
Because you know parliamentary sovereignty, over prerogative powers and over the referendum result and, what ppl often forget, over being in the EU!