Tough situation.
But... HE should also be taking full responsibility for the consequences of having sex. A lot of people get told they can't have kids, women also, but they are never 100% true. Women end up pregnant after they've been told they can't, and still handle the consequences whatever they decide to do.
How can he stop seeing your DD because your pregnant? That's heartless and immature. He can't force you to do anything. He is willing to neglect his responsibility of DD if you continue. Sounds like he's cutting his nose off to spite his face, to be honest - what exactly would he get from that? It's disgusting attitude.
A lo of women continue with pregnancies whether they expected it or not, unplanned or not. They still carry on. There is never any guarantee how many kids anyone will have in life, but when it happens you grow the fuck up and get on with it!
He can't leave you and your DD just because he doesn't want a second, that's ridiculous. Ugh, men that drop all their responsibilities because things don't go their way!
I don't have much advice, I'm afraid but it winds me up when men can make such a snap decision when women, who do also have a choice, are left with a much bigger decision to make that can effect you either way, it's a harder choice to make.
What would happen if you walked out on your DD? She would be left on her own, would she, or would he step up?
Sounds like he's manipulating you to have things his way. You do what you want with this pregnancy, if he can't be adult enough to accept these things happen, then really it's his loss if he's cold-hearted enough to leave you and his DD.
It's always expected that women pick up the pieces while men can walk away like nothing happened and have the life they want, no strings attached.
He really needs to fucking grow up! Does he not care about his DD or something? Cruel man.
I really hope he sees sense. 
(Sorry. Long post - I was left while pregnant by my son's dad, so it grates on me!)