OP you sound like my cousin who hates people. She had a hard time growing up.
She actively went out out of her way to avoid people and it did have a negative effect on her sons ability to make social interactions as he too is now a very unsociable 14 year old. Who sits in his robe all day with his mum drinking 'brews' and waiting for his online friends to come on line whilst there are actual kids outside his house playing footie on the green.
You have a responsibility to your son to give him the best chance of fitting in to society when he is an adult, don't turn him in to a mini you.
You can take him play groups, you just don't want to which is unfair on him. You don't have to chatty you can watch and just let him play with others.
You can do loads out side.
Take games, kite, balls, bubbles a picnic to a park
Buy chalk and draw pictures or hopscotch in the garden
Find a lake or stream and take nets to catch insects and creepy crawlies or even just wellies for a splash;
Get him a little trike or scooter and sit and watch him
Make a treasure hunt of wildlife things to find outside
Have a look at Pinterest.
Bake cookies
Paint eggs/pebbles
Write in rice with fingers
Make a daily planner and find some structure. You don't have to have a full ten hours of solid play but you absolutely can do shit - if you can be arsed. If your sitting scrolling on your phone all day then yeah you should guilty