For me, it has negative connotations because the less able children at my school were unkindly referred to as remmy ie remedial. That may not be the case where you are though, it could be geographical.
I also think of the male character in House of Cards. I think the character’s parents were French speakers.