You are never going to be a loser if you are a kind, decent man who treats other people well and does his best to get on with life and keep a roof other his head.
For me a loser would be someone who displays this type of behaviour: is abusive/aggressive/violent, lies, breaks the law, manipulates, has no respect for others, has low standards of hygiene, is addicted to porn, does not take care of his kids, is violent towards women, has no interests/passions in life, blames others for his mistakes and never takes any responsibility for his actions.
Many people are on a low wage and do an essential/valuable job and have to work extremely for it. It is never a sign that you are a ''loser''.
If you come across a potential partner who dismisses you and calls you a loser because of your job, ignore them and count yourself lucky they have shown you their true, ugly self...