CofE (assuming you are in England) says their remit is to be there for everyone, if you want to go and worship in a CofE church then you are welcome.
The services can be quite different, there is something called "high church" (not an expert on this) which is much more like RC in feel. So for our children's school, we have been to some stuff at that church (CofE) and I felt really like it was all pretty familiar and normal (raised RC) but DH who was in a very relaxed CofE found it very formal and weird. So, not all CofE are created equal IYSWIM, some feel more like RC some are much more relaxed and less, um, ritualised I guess is the word.
Bottom line is the church won't mind. It's fine for you to go along and see if you like it. It's the same god and the same bible. Obviously lots of stuff is extremely different but, for the singing and praying bits, well, it's the same deity.
Go and have a try if you are missing something in your spiritual life, what's the harm 
(I'm an athiest BTW so got no "side" in this, posting as was raised RC but have worshipped at a couple CofE churches).