I didn't use to swim I did use to swim NOT I didn't used to swim I did used to swim. You wouldn't say : I did finished cakes, or I didn't made that. Would you?! [hmm] When you are using an auxiliary verb you follow with an infinitive.