I had a baby carrier from early on and it was a god send. Helpful when baby was awake at night - baby carrier for 5 mins and back to sleep no bother. Even if they get a bit unsettled you can pop them in and you have your hands back to carry on doing whatever needs doing. I remember wondering what I would do without it.
Also, think about your pram - really think about it. I got the travel system only to sell it 4 months on - too chunky! Yes, baby needs to lie down, and your pram should be able to do this, but how your pram/buggy functions when baby is a bit older and sitting up is more important. Also, will you wait a while before baba no.2...? We didn't, now we need a double buggy. Some buggies on the market will work as a single from newborn and easily convert to a double for an expanding family.
As for clothes - buy what you need when and as you need it. I think white vests and sleepsuits in the beginning is handy - stains can be bleached out. Funk up with a colourful cardigan and hat.
A good playmat/gym is also handy. I was surprised how quickly our DC was interested in hers.
Oh, and lastly, one of those bouncy seats. Very handy, mine would sit in their quite happily with me chatting away nonsense whilst gettint on with housework or getting some dinner on the go.
And, actually, if breastfeeding - get a good 1litre water bottle and keep it handy - I'd get a mad thirst. And get a cup with a lid, like those thermos ones. You can have a cuppa and not worry about spilling it on baby. And if you get distracted it will be kept warm.