Of course you won't scar anyone, but but ditto Kristina, you may get sick of saying 'actually she's a he' to well-meaning baby-cooers in the supermarket.
I dressed DD in unisex clothes (apart from the sea of pink we were given by very kind people, who clearly didn't know me very well ) and I still do to some extent cos she looks so brilliant in blue (she's 2.8) and I'm so sick of girls clothes being covered in pink sparkly flowers and fairies. But I did/still do get sick of other people saying 'he', which is starting to get insulting, frankly, cos she's such a stereotypicaly pretty girl - blonde curls, blue eyes - but people can't be arsed to look beyond the colour she's dressed in. And they assume that any tiny dot half way up a massive climbing frame clearly designed for kids twice her size, must be a boy. Grrrrr.
BTW, if you choose the right places you can still get 'quality' bits and pieces at second hand sales, and then if you have a change of heart about your DC's style after it arrives, you haven't lost much. I've bagged quite a few bits of mini-boden and other stuff I couldn't/wouldn't otherwise afford, all in great nick.
The other words of caution, though, are these:
a) chances are you will be inundated with gifts and offers of loaners/hand me downs, so don't go mad or your DC won't even get to wear half of it, and
b) 'proper' clothes look cute but can be overly bulky, and a pain in the arse to wrestle an uncooperative infant into. You may want to throw a few babygrows in there too..?