T - no reason to feel guilty about the other dates. You haven't DTD with this guy yet (I assume) and haven't agreed exclusivity.
If you don't feel comfortable with him because you can't read him, it's okay to call it off.
If he starts asking if you're dating anyone else, that's kind of a crunch point. You can lie and say you're seeing friends, or just say you're not seeing anyone, you can shift the topic a bit and say how you want to take things slowly with him, but generally I'd think if he's going to push the issue then you have to either agree exclusivity, drop him, or say you're not ready to become exclusive yet, you don't know him very well and you'd like to keep seeing him (if you do) but can you save that conversation for later.