This is all a bit weird. Does he mean he doesn't feel attracted to you every second of the day (which is perfectly normal) or that he goes through phases of not being attracted to you at all (weird in a new relationship).
I think it's actually early to be talking about love anyway, three months in.
I wouldn't dismiss the relationship over one remark, I'd try to find out what was going on, it's so out of context, it's hard to say what was meant by it. I once asked my husband if there was a spark the first time he saw me, and he said no. He wasn't being mean, he thought I looked nice, but he didn't have a flash of 'oh my god, I have to marry this woman' on merely sighting me, that came on our second or third date when he got to know me better:)
If it's a remark designed to keep you on your toes, be harsh, but I can't see whether it is or not, or whether it's just honesty, I don't fancy people non-stop to be honest, and sometimes even very good looking people aren't that attractive, I don't find stating this quite the big deal it appears to be reading the posts.