I b/f for a year. I too had a problem with dh touching my breasts, although I think the issue with my libido was probably more to do with tiredness!
However, it did have an on-going knock-on effect: there was also (and still is) a problem in that dh would automatically "go" for my boobs, even though I said that I didn't like it, which would then make me tense up and stop enjoying myself - and he would get pissed off because I had flinched.
The sad thing is that if dh would have taken time to let me get warmed up, then my boobs would have come back "on limits".
Although ds is now 18 months, I still have an on-going issue with my boobs. I suspect part of it is now in my head, as I am annoyed at dh for not "respecting" my request that I didn't like my boobs being played with, and am now automatically tensing up every time he goes near them.
This is not to put you off extended b/f (I really enjoyed it and I am proud of the good start I gave ds) - but to advise you to talk through with your husband why your breasts are off limits for the moment and to get him to respect the reason.