Just brought our puppy home 3 weeks ago so have just done all of this......
You may want a bed to pop in the crate (one that you can bung in the washing machine)
Stock up on newspaper as you'll need to line your crate with something (and not sure if you are paper training, or garden training!)
Lots of chewy toys the kong is brilliant but the stuffing is expensive so we just pop peanut butter in so you may want to get a jar! Got some bone things too, and the odd cuddly toy (our puppy loves her's!)
Hot water bottle for pets - we got a microwavable bean bag toy to pop under her blanket in bed at night to help her sleep.
Obviously lead and collar (and id tag) poo bags too!
We also got a hormone diffuser thing which we plugged in to help her settle, this really helped.
You also need to think about how you are transporting puppy home (crate, harness, carrier?)
Oh and sleep in an old tshirt for a few nights which you can then put in puppy's crate at night.
Lastly we found that she slept much better if the crate was covered at night - so we cover it in a large picinic rug which helps.
Shop around - have found the internet cheaper for most things.......
Hope that helps!