Yes, I see your point, but that's the mindset that's getting you into a mess.
If you have extreme responses to things due to your history (as do I), that doesn't mean that you have to change your responses. You feel what you feel, so if you have a massive problem when someone opens a yoghurt (to give a daft example), then the solution isn't 'Oh, my feelings are just silly, I'm over reacting, this is a 'me' problem' etc. The solution is to find a partner who is comfortable with never opening a yoghurt in front of you.
This guy has told you he doesn't make much effort, and you feel like he doesn't make much effort. You'd like a partner who makes an effort. Where exactly do you think there's any room for confusion?
What you're trying to do is minimise your own feelings: 'He's doing something I don't like, but it's my fault for not liking it, so I should just try to act like that feeling isn't happening within me.' All you end up with is a complicated future, because the damage cause by your history lives on in the present, and you end up putting yourself in a situation where you don't feel right, and you just have to keep putting up with it.
Re The Holy Grail, we are all looking for that. Most people aren't compatible with most people. If you have more specific needs, then it will narrow down the field, and if it's so narrow that it's impossible to find a partner, the solution isn't to stay with a partner you don't feel comfortable with. The solution is to stay single until you work out what's going on inside you.