I've seen two references on here to this being a big no in just a few days. It's honestly not something that's ever bothered me.
Out of curiosity, is it something you care about or would notice on someone else?
This link is from 2017 so the clothing might be a bit outdated, but it would never occur to me that the colours weren't ok together.
https://www.edits-styling.com/blog/2017/11/28/style-rule-breakers-how-to-wear-navy-and-black-together