Apart from anything else, a lot of stuff including housing asylum seekers was outsourced by the last government to private companies like G4S. Since it is in their interest to make a profit, said companies would look to take the maximum amount from the government and house the migrants in the cheapest areas possible. Inevitably this meant not so much "working class" areas but the areas with the most deprivation, the least public services and low employment opportunities. Usually post industrial areas like Stoke. This wasn't fair on the residents or the asylum seekers.
After that the last government started paying hotel owners to take asylum seekers, beginning with people from Afghanistan many of them families the government itself had extracted but had not plans to house. Eventually this spread into a general habit of housing people in hotels whilst deliberately not processing their claims in the hope (they actually expressly said this) that not processing claims would put of other people from coming. Not surprisingly this genius plan didn't work, the backlog of asylum seekers built up and hotels got filled. The government spent lots and many hotel owners and private contractors (some of them with links to the Tories) made lots of money
None of that is a great situation. It's also not the fault of asylum seekers themselves, or the much demonised mysterious "middle class" all of whom apparently live in white only areas and are the only ones who don't hate migrants.
On a slightly related tangent it's odd how many people on Mumsnet are simultaneously hardworking home owners in expensive areas who would be punished cruelly by inheritance tax, mansion tax or wealth taxes AND also opposed to immigration because they live in working class areas that have been affected by asylum seekers in ways the champagne quaffing middle classes could never understand.