Sit down and work out what interests each of you and see where there is commonality or compromise.
We essentially had this when we emerged from a busy decade of full time work, teenagers, elderly parents etc. Suddenly we had time on our hands, or rather I did because I had taken redundancy because of the elderly parents, and money.
DH loves watching sport...of all types so I bought him a Sky subscription, and we decided to jointly support a football Club near my mother and go to matches. (His heart is still with Leeds....) He goes alone to cricket and rugby league but often selects matches near either our student daughter or his parents. I have found I enjoy the human angle, the progression of young players, and the survival of older players who rose from lower divisions.
I like walking. DH does not. He marches to the destination as if this is the sole point, with me tailing behind. He likes history. Walking holidays in interesting places with someone else setting the pace, works. (We both tend to duck out of group activities in the evening.)
He likes obscure films and heavy books. But we go to the theatre together. I am more sociable, and have a good group of friends who I see without him.
It works.