You did an exercise DVD while baby napped Elphaba? Blimey, that puts my cup of tea and Father Brown on the TV to shame 

it's the transfer that wakes him...the problem is he falls asleep breast feeding tho?.
As mentioned above, swaddle before feeding can help deaden stimulation when being moved.
I actually go for the complete opposite route though. I don't do gently-gently-careful-not-to-wake-baby. I would feed until asleep (as will always happen, you can't not breastfeed to sleep at this age), but I take the falling asleep as a sign feed is over, now it's time for sleep. So falling asleep at the breast is a signal, not the nap itself.
When baby starts dropping asleep I remove nipple and lift baby to my shoulder to wind. A few minutes back rub then put baby in bouncer. Yes baby is now not asleep - because I want the 'getting to sleep' to happen in the bouncer.
I know very definately baby is ready for a sleep though. So I don't give up on getting baby to go to sleep in the bouncer. I know baby is fed, I know baby is tired. So into bouncer, dummy in (held in if needed) and relentless bouncing. Just keep bouncing and bouncing, dummy to stop any crying and keep going until baby does eventually drop off.
Then just leave baby in the bouncer once asleep. Perhaps the odd gentle bounce if ever stirring at all, but other than that leaving baby there.