Shish - I remember suggesting a soother (dummy) before but you weren't keen.
What is you magically stopped breastfeeding and he took bottles but demanded feeds as often? You could find yourself in the situation of constantly giving bottles which could lead to a very fat baby!
The upside to the problem you have it that you have the facility to breastfeed on demand whenever he needs it. You also though, can not breastfeed him every time he seems to be demanding it. It may be that he likes to suck.
Since you have got him to suck something he likes, I would persevere with it but not force it. You might find that he is more likely to drink from other teats if you can get him to accept a dummy.
You will be able to wean him from the breast - honestly. Once he is six months and established on solids you can start to drop breast feeds. If he doesn't drink much, make sure he has 'watery' foods like jelly or icecream. He will eventually take drinks from other things when he is ready.
Like Tiktok says, I think it is unlikely he is nutritionally requiring fed as often at night - he obviously likes it.
Is he in the same room as you? Might be worth trying him in another room or at least at the other side of the bed so that he doesn't sense you so easily.
Today, instead of feeding him 2 hourly, try taking him out for a walk without a 2 hourly feed and see what happens. Although he may cry it is likely that he will fall asleep.
Is it likely that you have got into the habit of feeding him every time he cries? I think you need to get confidence not to breastfeed him everytime but distract him to lengthen the times between feeds. For your own sanity I would try a dummy.
All this feeding will come to an end - really.