Very pretty dress and think yellow shoes (that you've already got) would be excellent but with a yellow fascinator as well I think will be too matchy matchy. I think if you want the yellow fascinator you need to wear a more neutral coloured shoe, either metallic or blue. Or, since you've already got the yellow shoes wear a more neutral coloured fascinator (probably with a range of blues in it like the peacock headband).
Personally I think a range of blue accessories would look good but only if they are deliberately different enough blues, don't try and match everything.