You need to get a grip of the situation. The real situation.
He is not your boyfriend. It's clear you want him to be, as you refer to him as this even now. He's not. He's a man that has nothing to do with you, barely sees a child that he didn't want, and had sex with you, one off, because frankly, he knew he could.
I absolutely know you'll claim that as harsh, but you need to wake up and see this isn't harsh, but an accurate reflection of the situation, and the version you are trying to paint, is not.
You need to get over this man. As PP says, gently, two "oops" pregnancies are not common. Possible, sure, but not common. Children are not the way to keep him in your life.
The only thing you need to be thinking about, is how do you feel about being a single mother of two children, for the rest of your life. Because unless you meet someone else, that's what you'll be. And this can be utterly fantastic, if it's what you want. It won't be if you are kidding yourself this is the way to tie this man to being around you.
Whilst he may be paying you something, which is nice, I'll pretty much guarantee there won't be any 15hrs childcare from him when you decide to keep a second child he doesn't want to be involved with.
It absolutely takes two to conceive. Then it's entirely down to one whether that baby materialises to raise for the next 18yrs, and that "one" can entirely ignore the other parents wishes. In doing so, you need to take accountability that you are having this child in the full knowledge you are prepared to raise this child alone. He, likewise has a choice. To raise the child, or not. He can't make you have it/not have it, any more than you can make him actively raise the child.
Please, please, think long and hard about this x