Right, and if it is a field mouse then releasing it away from its territory means it will be running around petrified - brieflly.
Relocated mice experience predation due to an unfamiliar area without known escape routes, starvation as they cannot just magically find food and shelter and they also have to fight with the resident mice and voles in the new area, plus the stress and exposure.
They cannot be accommodated by humans, as they are filthy, disease ridden vermin who cause structural damage to the home, including chewing on wires, food and furniture (and anything else they can get their teeth into) and shit and urinate everywhere spreading diseases both through this and through airborne contamination.
And they cannot be relocated unless there's some sort of mouse magical kingdom a few miles away with no predators, plenty of food and lots of safe places to build a nest and they can bring their family with them, or they will just die anyway.
Being sentimental about filthy, disease ridden vermin can cause humans harm and ultimately gives the mouse a long, slow painful death. Far better just to kill them.