This is easy to sort, so don't worry. The central themes that you need to tackle are:
Go to sleep in the cot
It's a crucial part of the 4 month progression that baby now needs to learn to go to sleep in the cot (or the surface in which they will stay asleep- say the pushchair). Being put down already asleep is very poor sleep hygiene.
So every time, for every nap and at bedtime, start with baby awake and put down fully awake, then get to sleep and do not move baby once asleep.
Hunger
Have you increased daytime feeds recently? It's not unreasonable to see calorific need increasing by 25% at around 4 months (due to very fast paced development). If you don't keep up with calorific need in the daytime, it's not unusual to see an increase in night wakes because baby is hungry (even though they weren't needing night feeds before).
You usually get more calories into baby by having more bottles per day (ie feeds closer together). Because baby's stomach volume is a limiting factor with the amount of milk taken per feed, so they often cannot take any more per feed.
It's not unusual to need to do 2 hourly daytime feeds in order to fit all feeds into the daytime so that none are needed at night.
Seperate feeding and sleeping
To stop the feed to sleep habit, start feeding baby upon waking up from a daytime nap, rather than when going to sleep. Or feed midway through awake window. The idea is that baby learns that feeding does not mean sleeping.
At bedtime feed at the beginning of bedtime routine not the end. So feed first, then bath then might wear and then put down awake.
Naps in..?
Bear in mind that baby does not need anything fancy to sleep in. Sleeping in the middle of the lounge floor would be fine!
You could do cot naps if you sit in the bedroom with baby.
Another easy option would be to do all daytime naps in the pram or pushchair. Naps in something that moves makes getting to sleep easier and also assists you in resetting back to sleep is waking early. I'm not suggesting going out for a walk with the pram (unless you want to), just parking it in the middle of the floor and pushing it back and forth on the spot.
The bouncer is my favoured option. Park the bouncer on floor in front of the sofa. Bounce it with your foot while you watch TV.