OK, so the simple answer is the stuff I'm drying.
But if I don't tumble, there is no way we generate the amount of fluff coming off each load just wearing the clothes, so are we wearing the clothes out faster??
Just got a drier in the new house, and astounded by the amount of fluff that comes off the filter each load!