Yes i would want to know. I wouldnt want to bury my head in the sand and pretend its not happening. Also, if he is having sex with both of you, think of your health. Get proof, think whether you can stay and forgive, if not, look into your circumstance (housing, mortgage, money etc) and confront.