The OP is not being unreasonable. My earliest memory was of the light, and it was an incredibly powerful experience. In early childhood I kept expecting that the people around me actually knew about it, and chose not to talk about it.
The memory was very important to me. I suspected it would be wholly forgotten if no effort was made, because it was an experience so incredibly unlike life on earth in any way. So I made a point to recall the experience and remind myself over time. My thought was that, even if I forgot it, I might remember remembering it iyswim. When I learned to write, I put it in a diary to remind myself, etc. I looked out for songs like 'Invisible Sun' by the Police, read a lot of books looking for a like experience.
It was not until I was a young adult, I heard of NDEs. Realizing that I cannot say to you, reader, what exactly was the true nature of the subjective experience I am describing here, reading about NDEs was obviously an significant connection for me, given this secret history.
Ironically my father, an engineering Ph.D., was an atheistic scientific materialist. We had many conversations over the years about things that can be known, measured or possibly proven, and whether things may exist that cannot be measured or inferred from measurement. No minds were changed!
I've spent a lot of time thinking about whether there could be any way to prove or demonstrate what I would describe as a reality larger than what we can grasp within a zone of materiality, but have never come up with any idea. If such a thing comes, it will have to come from brighter or more inspired minds than mine.