I would work on the naps if I were you. I think in most cases naps mean better night sleep, but every baby is different and all that!
If it makes you feel any better you are doing better than me. DS is 10 months and wakes about 8 times at night (breastfeeding and bedsharing)
I honestly think each baby is different and so wouldn't expect the same to happen. 2-4 times a night is good going at 4 months, but why do you think he doesn't nap?
There have to be extreme ends of the scale for there to be an average and actually I think especially when breastfeeding it is completely normal for babies to wake frequently. Check out the Isis website and stay away from babycentre
I agree can you work on the naps? Two hours max after waking he should be ready to sleep. I would do anything you can.
Fwiw ds is 5.5 months and wakes at least three times a night to feed. They're still young I find it better to have a plan....keep going as we are until fully weaned. If still waking more than twice consider some gentle sleep training ie seeing if he will settle without being fed etc. Tgats my plan anyway