DC1 - I was literally desperate for a boy. I had repeated suicide ideation fixed on it (ie if I'd found I was pg with a girl I'd have needed urgent psych treatment and possible admission). In the event, at 20w we were told he was definitely male, and possibly had a medical condition incompatible with life. Although that "possibly" turned out to be "not", at the time my feeling was "at least he isn't a girl". So I do not believe that everyone necessarily doesn't care, as long as it's healthy, which is bloody rude to parents of children with chronic conditions anyway.
Second time around, after an intervening traumatic mmc, I wanted a boy again. Partly emotional, and partly for logistical/practical reasons - we had a general 3DC plan, but wouldn't have tried for a third if the first two had been opposite sexes. Again I was lucky; but again he was given a query diagnosis with lots of follow-ups and turned out to be ok.
Another mc. Then DC3 - this time I wanted a girl, for my idealised BBG set. We weren't trying for a girl specifically any more, because the clock was ticking, so missing fertile days seemed daft but I did hope, purely for emotional reasons.
This time I did not get what I was hoping for. I wasn't as ill as I had been with DC1 so neither of us was in any danger, but it did take a while for me to get over my disappointment. I did so by seeking out positive opinions/experiences of having three boys, and by finding a name I felt really positive about, and reflecting on the savings and other practical advantages of matching sexes. Within a couple of weeks I could scarcely remember wanting a girl.
Now, with a house full of boys, I sometimes feel wistful about not having a girl, but in the same way as I wonder what it would be like to have married a previous squeeze, or done a different degree, or something. I would not give up what I have for anything.
tl;dr - OP, it's totally ok to have a preference, whether emotional or practical. But I recommend finding put the sex antenatally so that any disappointment can be dealt with in the abstract, rather than being associated with your actual newborn. I listed my tactics above, and they worked. My "wrong sex" DC is such joy.