I think it’s a really pretty name actually.
I wouldn’t automatically associate it with Jenner/Kardashian, and suspect the only people who would are the people interested in watching that sort of trash tv-and what do their opinions matter to you.
I also see the mint cake connotation, but kids called Victoria aren’t automatically associated with the sponge cake...so...!!!
I’d say it’s a lot nicer than following along with all the Evies, Graces, Phoebes, Maisies out there (which are all horgeous names, but very not-original!)