Agree with what has been said - make sure you are stopping for the right reasons. Sorry to say it, but cold dinners come with the Mum territory, regardless of how you're feeding!
Feeding when out an about... Well, personally, I much prefer the idea of just breastfeeding as and when, rather than trying to sort out bottles and what have you before I go, and then when I'm out. Maybe I'm just lazy
You can breastfeed wherever you want (you are protected by civil law) but if you feel uncomfortable for whatever reason there are feeding rooms in places like M&S, Debenhams, Boots, Mothercare and John Lewis.
Bonding. I think you need to think about this from both sides. Firstly, there are other ways he can bond with her - bath time is a great one for dads to do, (and whilst he is doing that, you can hoover up - see, housework
) as well as story reading and just general cuddles and play time. Remember also that she is very small at the moment so the bigger she gets, the more she starts interacting, the easier it will be for him to bond with her. The other big consideration I think you need to have is the lack of intimacy you will have with her if you stop breastfeeding. That's not to say FF babies don't bond with their mothers, but if you switch from BF to FF, its not the same. Will you miss that?
I know its very demanding at the moment, and the first three months are really hard going, regardless of how you are feeding. A lot of it is adjusting to having someone else controlling your life!
You say you're worried you'll regret it... So if I were you, I would wait a little bit longer, for a few more weeks until she starts to settle into her own routine a little more. Its much easier to get to, say, 12 weeks and think "Yes, I've definitely made up my mind now" than to get a week or so into stopping and want to re-lactate.
I do know people who have regretted very much when they stopped, and who wish they had continued for just a little bit longer, for a variety of reasons; cost, convenience, missing supporting their child with their body, missing those baby cuddles whilst feeding... I also know people who switched to formula and have never looked back, because it was right for them at the time. Though if I'm being totally honest, those are the ones who had major problems breastfeeding.