I think it depends on how it's said. blatantly tongue in cheek is fine and dp and I do refer to each other as the Mrs and the boy.
however an ex once referred to me as his "bird" when warning off a male friend who had come over to say hi and give me a hug (he was very obviously guy so not sure why the territory war had to start). Needless to say he became an ex very quickly