Get the quick kill mouse traps.
Bait them with peanut butter, Nutella, or some other nut butter. They like chocolate too. Also bacon fat.
Set them by walls, up on your counter by the wall, under your oven, behind bookshelves, etc. Make sure you don't leave a baited trap where you could snap it on yourself. Ideally, set a few in spots where you've seen a mouse. If your stove top lifts up, lift it and set a trap underneath.
Get some bleach and sponges. Bleach your kitchen. Throw out the sponges you use. They pee as they travel, so your kitchen in particular needs to be decontaminated. You will see droppings like caraway seeds.
Make sure you don't leave any crumbs or other food for them. Don't leave pots or dishes in your sink. If you have a sink food catcher/ grille for the plug hole, clean it out.
Go around your house and look for tiny gaps and holes, which you can plug with steel wool from the hardware shop. You can buy it in bags (not Brillo pads). You're looking for holes no bigger than a pencil in diameter.
I recently had an influx of them and caught four. I hate the thought of them in my home, though they are very cute and have lovely eyes.