I don't get the idea of taking revenge on a pet for "giving" you toxoplasmosis. It is (almost always) due to touching cat faeces, rather than the touching the cats. It can also come from gardening.
Does the midwife really know that this is a recent active infection? If so, why are you not on antibiotics already, which is the standard treatment in pregnancy. In any event (not to minimise) it seems that, with treatment, only 29% of babies are affected by maternal toxo, and of those only a small proportion are severely affected.
"Newborn babies
Amongst newborn babies whose mothers had toxoplasmosis or active T. gondii infection during pregnancy, 20?50% are also infected at birth. The risk of infection is reduced if the mother receives antibiotic therapy while she is pregnant; 44% of infants born to untreated mothers with acute T. gondii infection are infected at birth, compared to 29% of those born to women with acute infection who were treated with antibiotics during pregnancy.
Some 10% of infants born to infected mothers are severely infected and show symptoms of the infection at birth. The remainder have sub-acute infection, meaning that they host active T. gondii parasites (tachyzoites) but do not display symptoms of the infection when they are born. In these babies, symptoms may develop later in life, although some babies born infected with T. gondii never develop symptoms of the infection.
Australian statistics regarding the number of babies born with T. gondii infection are limited. Studies from the United States have reported an overall incidence of congenital toxoplasmosis (toxoplasmosis in a newborn) of 1.1 infections per 1,000 live births. Up to 4,000 cases of congenital toxoplasmosis are estimated to occur in the United States each year."
The reality is that you have a 90% chance of having a healthy baby. Having cats around babies has also been shown to reduce the incidence of asthma. FWIW, we have a cat and two toddlers and it never occurred to us to get rid of her. I just did the litter whilst my wife was pregnant (and somehow, subsequently...)