I've worked almost exclusively from home for the past 4 years and always had the pleasure of working in very cohesive teams - the orgs actively hired people who were the right fit for that type of work and we all made an effort to bond with one another via 20 min chats on Zoom, or through weekly team meetings, with a once-yearly team offsite where we could meet each other in person.
It can be an issue if you don't hire people who can work effectively from home (e.g. easily distracted/lazy/need to talk to people in person to communicate well etc.), however that's something for management to sort out on an individual basis. Not babysit entire teams just because the manager can't figure out how to manage effectively.
It's a different beast altogether if you hired people and made them aware that in-office work was a mandatory requirement and therefore didn't select on the basis of being able to work from home, but not if you promised them work from home and then changed the goalposts.