me2002 Congrats on your pregnancy :)
To try to answer your question:
If you try to breastfeed on a 4 hourly schedule you will almost certainly find that "you don't have enough milk".
It was a common "problem" for mums back in the days when this was common advice. Amazing really, that suddenly mums couldn't make enough milk as humans had managed pretty well up to that point :)
In some cultures newborn babies are fed every 15 minutes. Really. Essentially they are carried in a sling and pretty much help themselves.
That doesn't mean you have to do that :) But human babies are designed to kind of drip-feed, to snack, to take in tiny amounts of milk into their literally marble-sized tummies and mothers are made to produce milk little and often. By making your baby wait for 4 hours your body will think it doesn't need to make so much milk as it's not being taken out. It's made on a supply and demand basis.
If you plan to formula feed then there won't be the same biological reasons to feed on demand from a milk supply POV. But, your baby will really be unhappy when s/he needs to eat and is not able to and her biological need to be fed on request won't go away. She will suffer from being hungry and while she may not remember that as an adult, it won't stop it being horrible for her as a baby. So it depends on your definition of "it didn't do you any harm" :)
Not to mention you'll have to deal with an upset (read: screaming to high heaven) baby when you could Just Feed Her.
I suppose, to turn the question on its head, why would you want to feed every 4 hours? If it meant that to do so you'd have a happy baby between regular scheduled feeds then I can see the benefit, but as you say you'd been distracted when you were hungry which takes an awful lot of mummy time and effort for no benefit :)
Babies need to be close to their caregiver (physically) and they need food. That's pretty much it :)