First trimester and feeling down

[Discopanda]

Hi everybody, I'm almost 7 weeks pregnant and already starting to get chubby despite eating healthily because I'm eating more than usual (only when hungry) and have had to stop doing high intensity cardio and running. I know I'm not massively big, but I just feel that it's only a matter of time before people start being horrible about my weight. When I was pregnant with my first, I was bigger to start with (big size 12) and working in an office, she was a big baby and I gained a lot of baby, water and placenta weight, as well as having HUGE boobs and people just thought it was OK to say whatever they wanted about my size, like the old "how many have you got in there?" type comments.
I'm starting to get really down about putting on weight, especially as I know that I shouldn't cut down on calories at the moment, I'm just trying to remind myself that I'm eating healthily for my new baby and to have energy to look after my toddler but it's really hard when I know that people can be so horrible, especially before your bump actually shows and you just look like you've been eating too many pies.
OK, rant over, has anybody else been in this position and what did you do? We aren't telling people until the first scan so can't tell people to shut up because I'm growing a baby.