Would you assume they thought you were "punching"?
Someone met my newish boyfriend the other day for the first time and really went on about how handsome he is and I wonder now whether she was surprised that someone like me could pull him!
I feel entirely secure with him and know why he likes me. My insecure side worries people must think we are mismatched and he could do better!