This is the big fear, oh but I might need it later - and it does happen, that's absolutely true. But it's well worth placing that against the need for space and calm in your home right now.
If you could pay someone to come and instantly make your home neat and tidy and clutter free, you probably would, right? So see re-buying these useful items as that fee that you're paying for your house to be nicer to live in and easier to take care of. It's probably much cheaper than you'd imagine. It is annoying to have those moments, but you're probably building it way up in your head and not really weighing it properly against the benefits of less clutter. That is because we tend to value what we already have (even if it's something very cheap and useless) way, way higher than something that we could only potentially have (the space and an easier time cleaning) - I'd guess that is even more true for something we haven't had before.
I quite like Dana White's motto - she says ask yourself would I ever think that I had this item - if not, then don't keep it, because you would have ended up buying a new one anyway. If you would think to go looking for that item, take it to where you would look, and if the drawer/shelf/box is overflowing, take out the least useful or least liked things and get rid of those.