WRT feeding, IME it's never as simple as "Just stop BFing" or "Just keep trying" - it has to be about what you feel.
If you could snap your fingers and suddenly have the ability to drop the top ups, guilt free, or drop the breastfeeding, guilt free - which of those makes you feel more relieved?
If breastfeeding is very important to you then it is worth getting proper help to continue, and enable you to phase out the top ups if that is the stressful part. But at least remedy/troubleshoot the latch since that sounds stressful.
If it's something you're doing because you feel you should, then absolutely drop the guilt and stop!
(If the second option ignore the rest of my post).
Just to go with some other info about feeding/boosting supply. The three most important things are this:
Keep the baby close
Keep the milk flowing
Keep the baby fed.
What this means in practice:
Skin to skin, cuddles and smelling their head are all as important, hormonally, as actually feeding them. Try to see this as a separate priority from giving milk. It may also help you feel bonded/attached.
You do not necessarily have to have a perfect or a long feed in order to stimulate your nipples to produce more milk. 10 minutes on each side is absolutely fine. If you cannot manage this at least every 4 hours, then expressing once in 4 hours again for 10 mins each side is fine. If you can/want to feed for longer, or more often, this is also OK :) but see it as a bonus. The thing which matters is getting some milk moving out of the breast for 10-20 minutes or so once every 4 hours.
It's not important to keep track of how much baby is getting breastmilk, and how much she is getting formula. Baby needs milk of course to keep her blood sugars and energy levels up, but the most important thing is that she gets fed, not what it is or how much. Try not to track ounces or mls, just feed on demand. Offer the breast first if convenient, but don't worry about cutting her off after 10 mins if you want to get some formula in as well, or if it's uncomfortable.
All this is best in conjunction with some proper experienced BF support such as from an IBCLC, La Leche League leader, NCT / ABM breastfeeding counsellor etc.