Yes, there's a point - more than one, but none will be enough if you have had enough of breastfeeding him and really wish to give up.
Primarily IMO is the health reason - you are still helping him to stay healthier by giving him what he needs. There is a theory that when you kiss your baby, it somehow gives your body knowledge of what antibodies your baby might need to fight off whatever is going on with them, and that you then make these antibodies for them and pass them on in the milk. I don't know how true it is but certainly you would be able to pass on antibodies in your milk (not sure about the specificity of them though!)
Your milk is still going to be the best source of nutrients that your baby needs, however good the cow's milk-derived formulae are (and they are), because it is specifically designed for your baby. Your milk takes all the nutrients first, you are left with what's left over once the milk has been made, so your baby will be getting what he needs from you.
It's comforting for the baby to feed from you, especially if it's what he's used to. My DS2 is still having a night feed, sometimes more than one, and first thing in the morning - but the last one at night will frequently be straight after a full bottle of cow's milk, and the one in the morning will usually be followed by a full bottle of cow's milk. He doesn't really need the breastfeed for filling up purposes now, but it comforts him and helps him sleep (at night) - and is his first drink in the morning.
Apparently hitting the breast is to make the milk flow faster, Shahsham - I remember reading that on here when someone asked her verbal toddler why he did it - so I squeeze mine myself to produce milk faster since then (nicer than being hit!)