Moving to exclusive formula, or mix feeding but with free amounts of formula through the day, are far more likely to improve sleep than a single bottle at bedtime.
The frequent wake ups you describe, if they are to do with hunger (and they may well not be - there are lots of other reasons), are likely to be due to low level hunger (total calories over 24/48 hours) rather than any hunger at a specific time that requires a one-off feed.
It's unlikely that baby is starving hungry when going to bed, assuming you feed before bed anyway. And a single bottle may not make any difference to frequent waking - because it has only minimal effect on overall calories over the whole day.
So if you are not previous about breastfeeding, by all means introduce a bottle at bedtime. If nothing else it means others can help with bedtime and share the load. Have realistic expectations though, it's not likely to be a Magic Answer.
If you are not previous about breastfeeding at all this time around (which is nothing to feel bad about, life is different with your second), maybe you want to keep breast feeding "for fun" or "for cuddles", but give very frequent formula feeds through the daytime to calorie load.
All that said...
In the middle of sleep deprivation is not a great time for making decisions. Are you absolutely sure you want to start mix feeding? It's a very difficult decision to go back on so be sure you don't look back at this decision with regret.