OP, you just got engaged to hopefully, the man of your dreams.
Celebrate that and bask in the newly engaged phase.
If you asked 100 people, half may say Yes, and half No, then what?
Do what feels good to you.
The media love to focus on size, but look how those celebrity marriages fare.
If you want a bigger one because this one doesn't suit you/your fingers then do, but don't so it based on people who only have a teeny window into your life.
I have a small diamond and did feel it should have been bigger, but thought of my DM and DMIL who both didn't have any stone at all, just a gold band and their marriages have lasted over 50 years each.
Not saying big = short marriage or vice versa, but try and see the bigger picture.
You Loved it and chose it, despite having other options for a reason.