I also only have a sunny windowsill! I started during covid with some free children's m&s seeds they gave out and never looked back.
I mostly do flowers but also love growing veggies too; I've grown brussel sprouts, pumpkins, radishes, spinach, kale easily on the windowsill initially, herbs too including parsley and chives, (chives look so so beautiful when they flower so I'd especially recommend these)
Viola, marigolds, petunia, cosmos, sweet peas (my favourite!), sunflowers have all worked previously for me with a reasonably proportion coming up. Petunia seeds are tiny and take forever - 12 weeks mim indoors but when you pop them out they basically explode and they're just everywhere by July.
Calendulas and poppies I've had mixed success with personally but will pop the poppies straight in this year.
Good luck! Brings me such joy every year.