This caught my eye because I've been considering Gloria, prompted mainly by the Patti Smith song and partly because I think it has a wonderful meaning.
I think associations are irrelevant at the end of the day: children claim a name and make it their own. Over the past few years I've met babies and toddlers called Agnes, Stanley, Eric, and lots of other names where my first reaction was, 'old lady/old man's name'. Within months, I can't think of it as anything but their own name, and you start appreciating the name for its own qualities rather than any associations you might have.
Everyone has very personal associations with names: it's not very useful to say 'Ooh, I knew a xxx at school and she was horrible' (people still do it though, don't they?!). I say, if you like it yourself and there are no famously denigrated examples in popular culture at the moment (Jordan?), go for it!
Of course, the next thing that happens is that you choose a totally inoffensive name and then someone awful rises to prominence three years later...