I'm crap at growing sweet peas from seed but one thing I know is they need deep roots so Best to grow 5-10 seeds in bigger pots, little ones die out too easily. Try transferring them carefully to a big pot.
We have a localish horticultural college who plants them in December. I buy large pots from them & plants are great. I have a load like yours that are useless & some that might survive but it's not worth the stress for me any more until I have time to tend to seedlings-I tend to forget about them for quite a while & then they're gone ☹️