@Lostinlife89 if you are not sure don't do it, delay. Once you make this decision there is no going back, you need to be absolutely sure before you go through with this. If your husband isn't supportive of the decision either you could lose him in the process. Its your body but its also his baby. Talk it through, tell him your concerns and he may alleviate them. He would need to check his works policy on maternity /paternity to see what the package is, every employer will have a document to read through about the length of time off that is paid and the % of the salary paid. If you are this early you also have a good few months to save so you can have some time off during pregnancy.
I understand your career worries, but as someone else mentioned, between jobs might be the best time. My friend who is a lawyer got offered a job whilst she was heavily pregnant and started that job after nearly a year off on maternity in her old job. I have another friend who has 1 child and they go travelling to wonderful places with their child.
Unless you earn loads of money, and some people do on mumsnet, there really isn't a right time, you will always find a reason not to, I have been scratching my head, rearranging finances to try and make this work and everyone just tells me it works out in the end.
I'm not saying don't terminate, but I'm saying travelling doesn't have to stop, in fact they are free to travel upto a certain age! Careers don't stop, if you are good at what you do an employer will want you, and if you may not get pregnant again you really need to be 100% sure of your choice first.