I’ve been trying to think why it bothers me so much you want to use this name, which in itself is a very pretty name. I think it’s because it’s used mainly by the ultra orthodox community, a community who live and breathe Jewish law and it governs every aspect of their life. It is rare that one leaves that community, although obviously a very small number do. For someone who has Jewish ancestry, but declares them self Christian and I have no idea what that means, it could be anything from you or your partner being Jewish to one great grandmother 150 years ago having been Jewish, if feels a bit like a lack of respect for Judaism rather than a commemoration of it if you’re not doing anything else Jewish.
i think there are many other Jewish names which are lovely to recognise your ancestry. Rivka is used mainly by a community whose every move, action and thought is governed by Jewish law it feels disrespectful to use the name for a family who have no real Jewish connection or practice.
other Names secular Jews just wouldn’t use would be names like Mendy, Shloimi Baruch Aroni Avrami Yitzi for boys and names like Chava Chaya, Penina, Soroh, Elisheva batsheva for girls
A more appropriate name used by more modern Orthodox Jews would be some of the girls ones I mentioned before: Shiri, Ariella, Tamara orli Tamar or for boys Eitan Ariel Rafi Natan Asher Yoni Tomer
I think it’s important if you want to recognise your heritage then you should do it in context. If not, crack on