Sorry to be that person, but paper is not the great alternative companies make it out to be, either. It might be more biodegradable, but it comes with many drawbacks compared to plastic, too.
It takes more energy to recycle (let's face it, generated by fossil fuels), more chemicals to recycle due to bleaching, has a larger carbon footprint because it is much heavier by volume than plastic (so needs more fuel in transport) and uses vast quantities of fresh water in production. People also don't tend to reuse it, making the cycle worse.
So reducing is the only way forward, and also the only one to save money and not spend more.
Buy metal, glass, ceramics or wood over plastic where you can (kitchen utensils for example - there are a lot of swaps to make), but where you buy plastic, make sure it's good-quality hard plastic that can be reused over and over. Learn to mend and sew and get things fixed or turn them into something else that's useful before throwing them out. Clothes into children's clothes, bags, patchwork throws, rags for cleaning. Use the trades to get things mended before considering buying new. That sofa can be reupholstered, that car can last 20 years, these shoes can be reheeled and that piece of jewellery just needs a new link. Stop fixating on things matching a theme in your home and buy second-hand where you can. All of these will have a far bigger impact than a soap bar.
I know you have good intent. But reducing should be at the forefront of our shopping and living habits, and a lot of what is suggested here is about more consumerism, where we worry about the type of straw to buy without considering just drinking from a glass in the first place.