I've spent my entire life being told I am not clever, just have a good memory! Imagine that as a kid in school when they give out prizes for x, y and z and you get told, very time, that you aren't clever, you have 'just' memorised the answers! Spelling? Nope, not for you. Other kids can spell elephant and get a sticker but you try and nope, you don't know anything. DSis gets told she is clever, DM tells me DSis works hard to learn but I 'just' remember things!
I am observant, curious (see user name), and remember passing information. Don't ask me why or how, I just do. I used that 'trick' to gain 2 good degrees, lectured a science based subject for a couple of decades and now run my own business. And I am still 'just' lucky because I have an eye and ear for small pieces of information.
So, if you are unobservant, lack curiosity (who doesn't read the labels and packets of breakfast stuff as a kid?) and can't recall trivia then no, you aren't at all unintelligent, you just aren't actively storing information as it passes you.
I have, it appears, what is known as a superior autobiographical memory. Doesn't make me a genius, or a memory chanpion. It just means I remember stuff and am good at quizzes!