Do you own your home? Rented, in yours and his name?
Practically speaking, I guess you need to talk and explain your change of mind. 'We need to talk'. Sorry but that's about it really. Who moves out depends on kids if you have them together, and tenancy, home ownership.