You're not unreasonable to have concerns, we should always be aware of the risks when we send our children to any activity without us - whether that's school, scouts, out with friends etc.
But you are unreasonable to stop your child trying these activities without at least investigating the risks further, and weighting up the risks when compared to the benefits that your child may receive.
Go and talk to the scout leaders, ask about their safeguarding policies, and how they work in practice. Talk to other parents. Talk to your child about grooming, abuse and what to do in the event that they feel uncomfortable. It's really important that your child feels they can come to you, or another trusted adult, if they are in a situation that they feel uneasy about.
If there's a space available, and you've talked to the leaders, then let your child try it out for a bit, see if they enjoy it, volunteer to help at a few sessions, build a relationship with the leaders yourself.
If you really don't feel comfortable sending your child on camp then don't. While scout camps are amazing, scouts do so much more than just camping. It's not the be all and end all if they miss the camp.