Dress history is part of my job and my academic background
Yes, and it's a part of mine too, though I am sure smaller than yours.
Cloth rags were cheap. They couldn't not be - or you wouldn't have a paper industry.
I grant you that brand new clothes were expensive, and so were good quality second (third, fourth) hand clothes. But, that has been the case for the vast majority of history. It is only in the present day that cloth has become so appallingly cheap that we can all afford cheap, disposable fashion. That is really an anomaly. It does not mean that, because cloth was not so cheap (income for income) if you were a Tudor peasant as it would be if you were buying your smalls in Primark today, that cloth was not cheap in Tudor England.
I don't think we are really disagreeing about the history, but I think we are disagreeing about what it means. I am arguing that clothing probably did smell a bit, and that's not in proportion to the price of clothing - it's just intrinsic to the fact that people wore things that were hard to clean. I am talking about people who could have afforded huge, fancy wardrobes, but still couldn't make their fancy gowns smell pristine after a few wears (and I doubt anyone cared). It seems to me that you are arguing that clothing was still expensive for people further down the social scale, who couldn't afford the many changes of linen you mention. I agree with that. But I'm also bemused as to why that's relevant, since you were talking about people who could afford lots of changes of linen?