Hang on, he drank the amaretto after you got back? So not in sole charge of the children at that point.
So whilst in charge of the children he had 3 beers and a glass, maybe 2 of wine? Honestly that seems OK to me, especially since he must have a reasonable tolerance as he drinks frequently. I'd be highly surprised at a regular drinker showing any real signs of drunkenness on that amount.
I still think, despite the drip feeds, that YABU based on your original question. I don't think the amount he had that night whilst in sole care of the children was necessarily too much, and I don't think having a "blazing row" with him because of it was reasonable (and nor do I think it is your job to tell him how much he is allowed to drink when in charge of children)
As a separate issue, however, you appear to have an ongoing issue with his alcohol intake. This would best be dealt with by calmly chatting to him in the morning. I still can't really tell how much of an issue it is from your posts. If drinks like you describe once a week or so, not really an issue, if he's doing it every night, then rather more so.
Without actually being there, its really hard to see where the issue it. It could be that you are overly controlling, and that he quite reasonably likes few drinks which is absolutely his right as a adult. It could also be that he's a borderline alcoholic who is pushing you to your limits, and not able to behave responsibly. On here, we're only ever going to hear one side of the story, and it would be impossible for any one of us to really know what the true situation is.
Blazing rows are never the way to go though. Especially not when one (or both) parties have been drinking.