I know this is a zombie thread, but did the relationship end or improve... Or still feeling weird?
I was in something like you describe once. I asked the man about it on a few occasions and he denied there was anything wrong and said he was really happy with me, but would never say he loved me. (He had whispered "are we falling in love?" in the first month when we were having a passionate time, but never again). I texted him I love you to him one time and he went radio silence for the rest of the day. Which left me feeling totally abandoned. I explained to him several times that I need a lot of spontaneous affection due to my neglected childhood and it didn't inspire him to offer any, ever. We spent a year together.
Eventually, like you, I started losing feelings for him. It was a very sad time for me because he was so cosy and comfortable and the physical was wonderful. He mentioned his ex wife regularly and often referred to exes. Yet he always wanted to spend his days off with me. I was very confused, to say the least.
Anyway, I gave myself some counselling and came to the conclusion that I needed more and I didn't want to go into a life ahead feeling 'not quite' loved, and, as you say, weird. So I quietly said my goodbyes in my mind and slowly disengaged over 6 months. I'm not good at sudden endings (childhood stuff) so have to make my departures slowly and peacefully - by grieving in my own time (the childhood stuff).
Finally, I just wasn't there and I wasn't feeling it. He was shocked and hadn't seen it coming, as he said. I was able to have that conversation with him from a safe place of no longer needing or wanting to be loved by him. It was a huge relief for me and I was able to reflect with him that I had tried to ask for what I needed and for him to express his love and affection for me, and he just didn't for that whole year we were together. He said he wasn't good at expressing his feelings, but that he did have them for me (He still couldn't say the wards I needed him to say!).
We parted company and I unexpectedly met a man 6 weeks later who showered me with love and shows of affection on a daily basis. He's a treasure and he fills the void that the ex didn't feel able or moved to fill.
I felt weird and incomplete and was always going to feel that way with that first man, so I had to do what I needed to do for my own long term emotional health. I wanted him to be different, but he didn't show up for me and I didn't want to perpetuate my sense of childhood abandonment and emotional neglect into my future. I ended it on my own terms and having weighed up what a drab, grey existence it would likely become.
Do what you need to do, make your peace with it in your own mind, and go as slowly as you need to. Show up for yourself, because your man isn't going to. You've stated your case to him and he hasn't delivered. If you can live with the emptiness, go for it. If you can't...run to the light.
There are lots of men out there who are a better fit for you, I promise!