They didn't want to reference the conflict, they wanted to reference sexual slavery, they were quite specific when they changed the name from Warsaw in 1978
With the proviso the following is from Wiki and may be inaccurate I can't find anything to support that.
BuzzcocksmanagerRichard Boonand frontmanPete Shelleyhave both been credited with suggesting the band name "Stiff Kittens", but the band settled on "Warsaw" shortly before their first gig, a reference toDavid Bowie's song "Warszawa"
To avoid confusion with the London punk bandWarsaw Pakt, the band renamed themselves Joy Division in early 1978, borrowing the name from thesexual slaverywing of a Nazi concentration camp mentioned in the 1955 novelHouse of Dolls
The packaging ofAn Ideal for Living—which featured a drawing of aHitler Youthmember on the cover—coupled with the nature of the band's name fuelled speculation about their political affiliations.While Hook and Sumner later said they were intrigued byfascismat the time, Morris believed that the group's dalliance with Nazi imagery came from a desire to keep memories of the sacrifices of their parents and grandparents duringWorld War IIalive. He argued that accusations ofneo-Nazisympathies merely provoked the band "to keep on doing it, because that's the kind of people we are"