We have a crèche at the back with a huge chest full of toys, v few noisy ones, but so many that all the infants adore just getting them out. It is the perfect dumping point for everyone's old plastic. It's magic. And they take the cars etc and make vroom vroom noises but it's fine.
Then we have fabric busy bags, so when you choose your busy bag you never quite know what's going to be in it. Each one has a colouring book, pad, pencils, toys, something like a shoe lace with cotton reels or one if those shoe lace sewing cards iyswim and a little book , some times with a biblical theme. And you can sit on the pew with mummy and go through them. Again, not new, but dumped, sorted, recycled.
I'm afraid unless you have a group of parents prepared to share, you are in for a few years of adult frustration.
And yes, I find RC churches are generally far more tolerant. IMV, that comes from a ban on contraception in most cases and a demand you attend church each week. So babies and their noises are the inevitable consequence.
In our church there are a few tut-tutters. But the clergy are clear that the early morning service is calm and peaceful, and the children are as much the present congregation as the elderlies. It can get a bit tense sometimes as there are some SEN people who can be noisy, but the congregation has learned to cope.
I'd talk to your clergy.