Welcome to the side of reason and logic 😊 There is 'magic' and wonder over here, too, and exponentially less guilt. Religions tend to lean heavily on what we must and should do, be, think, feel (or not). Any psychologist will tell you that 'must' and 'should' directives pose a risk to one's mental health and wellbeing. Their power rests in the sense of inadequacy and guilt, even shame, we're expected to feel when we don't follow the directive. Shame is a vicious emotion.
I wonder if your residual unease comes from this? You internalised religion as a life focus for a long time, is it possible you still feel guilty or inadequate for not believing and abandoning the rituals you 'should' follow? I'm giving you permission to go guilt-free and with pride in your independent spirit!
If affirmation from a stranger on the Web isn't enough (I'd be tickled pink if it is!) it might be worth finding a counsellor to talk it through with. If you're in the UK, your GP's reception can refer you to some therapy services, which are pretty lightweight but probably all you'd need.
If it helps with thoughts about your children - I'm the child of an atheist and an agnostic. We weren't baptised. We received a generalised education about world religions, contemporary and historical, with more information on Christianity because it's foundational to our culture. My parents told us we were free to make our minds up for ourselves, and they'd support us if we wanted to explore anything in more depth.
I went to Sunday school for a few months and played with Buddhism in my teens. One of my brothers, who's worked abroad extensively, has become something of a religious polymath as he likes to get into the culture of wherever he is. We're all atheists except one sister, who's a sort of quasi-Viking pagan and wouldn't really call it a religion.
What you've written about church providing culture and community makes me think you might be in the USA, where churches play a bigger role in social life than they do here. Even in America, most people are atheist/agnostic and I'm sure there's plenty of other group activity for your children to explore: sports, clubs, scouts/guides, after-school groups and more. Kids are naturally great at making friends; all you need to do is lead them to a space with some other kids 😀
I'm aware some atheist Americans join church groups for purely social reasons; this might not be the best idea for you while you're still finding your way around your freedom, but there's nothing ethically wrong with it. You might get more satisfaction by developing friendship circles around more secular activities (children, classes, sports, entertaining, etc) and building your world from there, the way you want it.