Andrew is suffering the consequences of speculation. I don't think his life is in tatters. He is only losing titles because all the sordid details make the royal family look bad. That's all.
It's not the same as being arrested, going to trial, being questioned by police and lawyers, facing your accusers, and either being cleared or going to jail. All that, in the public eye.
Interestingly, his privilege is a double-edged sword - he gets wealth, deference and powerful protection from the royal family, but he can't defend himself without bringing them into disrepute.
He could put a stop to all this now by offering to speak to the FBI and to the Met. The fact that he hasn't done it invites people to draw the conclusion that what's hidden must be even worse than what we've heard.
Again your point that many more men are involved stands. I am hoping that this might be the beginning of others facing consequences. I know at least one other man has been easily identified on Reddit from details on Virginia Giuffre's book.
I wonder what all those vile abusers are thinking now, whether they feel safe or a bit uneasy or sick as fuck.