If your ex moved into his girlfriend's house and then your kids had to sleep on the sofa every time they stayed with their dad?
Would you say anything?
YABU - it's absolutely fine.
YANBU - he shouldn't have moved somewhere they had no space of their own and you should raise it.