I think half of good baking for novices is good recipes. There's alot of great ones out there, but also alot of bad, and if you are inexperienced you might not realise if proportions are off, or texture of batter seems wrong... Hummingbird Bakery, Janes Patisserie, Cupcake Jemma all have brilliant, reliable, recipes for people who are not confident. BBC food I find incredibly inconsistent in recipe quality, but they have reviews, so read them beforehand.
I can't recommend the book Short & Sweet by Dan Lepard highly enough, it is fairly thick, but really covers the bases of baking - bread, cakes, cookies, traybakes, pastry, sweet, and savoury. I have had reliably good results from this book. In the intro for each chapter, such as cakes, he will discuss each ingredient (butter, flour, sugar, eggs...) and what purpose they serve and how they affect a recipe. For me this understanding has made me a better baker.
As PP have said you don't need much equipment. Electric scale, electric mixer (hand or stand), rubber spatula, balloon whisk, measuring spoons, and large bowl - I like stainless steel as they are light, heat safe so can be used for Bain Marie, and dishwasher safe too.
I only sift if making something like macarons and consider my bakes very good. I also don't always use butter, many of my cakes I use stork to great success, though obviously not for things like buttercream! So while the tips given above are peoples own experience don't take everything too seriously, as different things work for different people.