What would you think? It was said as a warning to typical 2yo non-compliant but not problematic behaviour. E.g. time for dinner, stop playing now sort of thing.
My take on it is either -
Daddy will withdraw his affection
Or
Daddy will leave you with mummy
Either way though the clear implication was that the 2 yo wouldn't like daddy to go home so it would be a punishment.
Ex is having contact at my home for his reasons.