I do think people in Germany were victims - please don't think I don't. And I don't want to pick on it.
But, what I think is important is, this man was a figurehead. He is not an ordinary citizen, and he is the head of a Church which has a really specific theology of sacrifice and witness to the truth. As a person, no, he's not to blame for being part of Hilter Youth. As God's vicar on earth, theologically, I do think the question has to be, was he strong enough to represent all of that? He himself didn't think so. He didn't refuse to be part of Hitler Youth. No normal person would. But, he was the Pope. It's a higher calling. If you are going to subscribe to a theology where someone is given such a huge weight of authority - enough to ban condoms in countries where AIDs is rife, for example - I think you must expect to take the flack with the positives. If he is God's representative on earth, do we really believe that God would not have object to the Hitler Youth? And if we judge him on human grounds as a victim who didn't have the super-human strength to fight that such a small number of people exhibited - are we not then saying something very problematic about the theology of the Papacy?
My issue is not primarily with demonizing members of Hitler Youth and I hope to God that's not what I'm doing. I'm saying, there is a theological problem here, and it is very likely (to me, as a non-Catholic) that the issue is to do with according far too much to an ordinary human being. But it is an issue.
It is appalling (IMO) that we are expected both to treat the Pope as an ordinary human, not an extraordinary saint like those who spoke out against Nazism, and we are expected to accept him as God's vicar on earth.