It's not stupid and it's very open minded to pose the question.
I think it depends on your view of suffering. You need to consider the life of the animal (such as tail docking vs munching grass) plus the end of life experience and whether it is a worthwhile life.
Controversially, I wouldnt consider dairy products to be vegetarian as they cannot exist without breeding a cow and putting the calf into the system (female) or killing the male calf. In order for people to have cow milk, a cow must be lactating, therefore continually bred from, so to me, it's not vegetarian because an animal is being slaughtered, even if the flesh is not the product the person is consuming directly.
I dont eat meat but that is due to a number of reasons - animal welfare, antibiotic resistance concerns, social reasons (the pasture could be better used and the grains fed to animals better used to feed people) plus climate concerns.
There is a lot to consider! But even cutting down significantly, without calling yourself vegetarian or vegan will reduce the quantity of suffering/improve environmental impact, even if you dont choose a higher priced or higher welfare option.
You dont have to be perfect to do your bit. Millions of well intentioned, imperfect choices lead to a greater outcome than one perfect vegan if you see what I mean so dont feel overwhelmed or like you need to make perfect choices all of the time. Every but helps :)