The thing is....why if he has been home for the last ten days or more....why has he suddenly asked his family and friends to come over for lunch?
Didn't he see everyone over this period...obviously not or even minimally.
He may or may not be planning anything re: his family and taking the children....but it's just so odd to invite everyone over, insist he sees the children....but only at the house
.
This is also is totally out of order, in the sense that it's your home (both you and the children) and he's having a lunch there...like its a happy time.
Maybe, it's time to revert to plan A and insist you meet at a neutral place or half way (he could ask his parents to take home).
Maybe ask the refuge for advice?