I started off in January so still just a novice myself but I bought a basic sewing machine from Tesco-it was around £80. I do keep looking at the more expensive models but at the moment I dont need any of the extra functions, simplicity is what I am after. It is very easy to thread and I picked it up within a couple of goes, I can now thread it (exluding the needle) and reload the bobbin without concentrating at all. Mine has 19 stitches but I only use the zigzag stitch and a straight stitch atm and although it can do buttonholes I havent ventured there yet. I have made lots of baby trousers and dresses for DD and DS on it, some curtains, treasure bags and bunting for a party, baby toys, nappies and bedding for dollies etc and am about to embark on a padded robot playmat!
Things I use all the time are:
Baking/greaseproof paper- for tracing pattern pieces onto from so I can cut them out of this rather than the tissue paper pattern sheets-makes a pattern usable for longer
A good ruler-I have a plastic quilting ruler and a metal one
A good pair of fabric scissors (only to be used for fabric)
A pair of pinking shears
Pins. I made myself a wrist pincushion out of some felt and velcro-very simple but makes life so much easier!
Basic set of needles for hand sewing
Thread
Measuring tape
Something to mark out the fabric, I like fabric pencils
Notions-I like to have bits around for impulse projects-velcro, bias tape, elastic, ribbon, buttons etc. I also have a couple of bodkins (metal needle things to thread elastic through waistbands-you can also use safety pins for this) and some bondaweb (sticks fabric to fabric for applique). I also have a big bag of polyfil stuffing which I use a lot for projects with the kids e.g. we jsut made stuffed felt rectangles with their names on for their bedroom doors.
I do have a rotary cutter and mat but dont use it very much at the moment.