Wow, I could have written those two posts about myself exactly.
No, I very much doubt that you are a horrid person because you have no intention of hurting anyone.
I've had these same problems for many years, I could get accused of arogance and I was actually listening to what someone else said, told them they were right and did it. And I'm absolutely puzzled by it. My boss is forever pulling me up on it, among other things.
I think I might be able to explain this. If you believe these things are causing you distress in life, I'd suggest you look up symptoms of high functioning adult ASD (you may find similarities in childhood and teenage years as well). I may be wrong, of course, but it does sound a lot like it to me. So maybe you could speak to your GP about it? Or possibly your partner?
It can often be less evident, but just as much an issue, for people like yourself who are obviously of above average intelligence because you'll often learn to hide it and compensate for it so that others don't really notice, as such. But the problem is still their, it's just hidden well.