Doesn't it drive you crazy? Come in and cat is yowling to come in. I say "fine, but are you sure as it's a nice day!'
Yowl.
Let cat in; within ten minutes cat decides he wants to go back out

We got a new door two years ago with a new cat flap which cat is scared of (he has a brother who isn't remotely bothered!) so cat flaps are not the answer.
Come share your irritation with me!