This is clearly how your exH was brought up, OP.
Now it is time for you to show this shouty man that actions do actually have consequences. I take it from your comment that he would shout at you in the cafe and cause a scene if you had approached him that you are a bit afraid of him. I take it from your description of his attitude towards his responsibility as a taxpayer and as a parent who is responsible for a child (in monetary terms and in terms of care while she is with him) that he is a scofflaw - someone who thinks the rules don't apply to him. A cake and eat it sort of guy.
I agree 100% with Ennirem's posts here even though I advocated that someone (you, since your ex won't) needs to step up and provide for the DD. I think you need to provide a few essentials. But ultimately you need to put pressure on this man, because the stakes are high, and neglect in one area could be an indicator of neglect in others. I agree with those who have warned you of lackadaisical supervision as she grows older and reiterate the warning that children who are clearly not being physically cared for are often targeted by people who will exploit them.
OP, you should shop him to HMRC.
You should consult a family law solicitor.
Do you have a court ordered visitation schedule?
Or is it a gentlemens' agreement?
If there is no court ordered schedule you are within your rights to stop visitation until he shows you the actual clothing, bedding, bed, furniture such as chest of drawers, toothbrush that is not years old, toys, books, writing and colouring materials/other stuff she is interested in, and all the other trappings you would expect to see in a home where a child spends her time.
He will be angry of course that someone is trying to make him fulfill his responsibilities. But ultimately you have to protect your DD, and this may mean summoning up your inner Mother Bear until you get the result you want.
Visitation has to be in the best interests of the child. The concept was not invented as a nod to either parent's 'rights'. The only one with rights here is the child. The people with responsibility are the parents.
Don't let him get away with neglecting her. She has the right to be cared for properly. Don't let him get away with thumbing his nose at his responsibilities.