For baby:
Sleepsuits/vests/babygros: tiny clothes are fiddly and uncomfortable - DS lives in onesies!
Snuzpod: (or similar co-sleeper) - made the newborn stage to much easier
Playmat: ideally with arch with hanging toys so baby can amuse him/herself while you make a cup of tea etc
Breastfeeding pillow: saved my back!
Pram organiser: got a great one from JoJo which has a magnetic seal - gives easy access to phone / wallet / travelcard
Lamaze toys: babies love 'em!
For you:
Kindle: easy to hold in one hand while breastfeeding
Leggings: you will live in them!
Slip-on shoes: so you can get them in and off easily at playgroups / Rhyme Time etc when you might be asked to remove your shoes while holding a baby