NC'd in case anyone recognises me 
My EXH and I have 2DC, 7&5. We have been divorced for 4 years. EXH has had a few girlfriends in that time and introduced DC to at least two of them (I didn't know until after the fact). He now has a girlfriend who has a baby (not his) and they've been together between 1-2 months. DC go to his every other weekend but I found out that the last time they went, they stayed at his girlfriends house. He has messaged me today to let me know that he will be moving in with her and that from now on, when he has the DC, they will be at her/their house now with her and her DC there. AIBU to be concerned that it's too soon and that they could grow attached to a person and their DC and then not see them again one day. He continuously cheated on me during our marriage and left me for OW (then begged to come back, but that's a whole other story).
For context, I have been with my fiancé for three years, we've all (me, DC and him) lived together for two years and we're getting married next month. So whilst they do live with myself and my partner, we've been together for years, are getting married soon and he's the only person I've been in a relationship since their dad. He treats them like his own and they love him very much.