I've got what I thought was a spot on my breast near-ish the areola that's been there a while, at least 3 weeks.
I hadn't noticed it till one of my girls pointed it out when I was complaining about a different spot, 
Anyway that was 3 weeks ago and it's still there, not doing a lot, it's not very big, 5mm at most, not scabby as such.
Anyway when would you see a doctor or wouldn't you?