I completely agree with @nomoremrsniceguy
Honestly, I think you're asking the wrong questions and concentrating on the wrong things. You don't have to make a big decision about breaking up with him or giving him an ultimatum but there's things you can do immediately, for yourself, which will drastically improve a good relationship and might highlight the problems in a bad one.
He's taking the lead and making the decisions because he can and because - I'm sorry - you're letting him. Concentrate on you and making yourself happier. Find a hobby or group you're passionate about - try meetup to see what's happening around you.
Spend time with your friends who aren't too tied up. Find new friends, go out more and get a new job, one that you don't hate. Make your plans and then fit him in around what works for you - just like he's done.
It sounds like someone's done a bang-up job of squashing your self-esteem. I'm hoping it isn't him but regardless, you need to work on yourself. If you're struggling and fed up, try something like CBT which will train you to stop being down on yourself.
Make your own happiness, don't depend on him to provide it. Then, when you're confident, busy, popular and enjoying your life, you'll care less about waiting on him and he'll care more about fitting in around you. And if he doesn't, then he wasn't right for you - and being a happier person will mean that you move on quicker and find someone who wants to spend time with you, wants to share your happiness and doesn't make you feel insecure.
Sometimes it can be hard to dig yourself out of a rut but you can do it and you'll be stronger for it afterwards. 