Would you move from perfectly adequate house, close to school and work to escape noisy neighbours (on 3 sides)?
Alternative would be a nicer area, nicer house but not walkable to school plus a bigger mortgage.
AIBU - yes stick where you
AINBU - take the new house