Both DD and DS were like this, in different ways. DD was dry day and night before 3, but for a while would demand a pull up for a poo. As she was under a doctor for bowel-related issues anyway, the doctor told us to roll with it, we did, and eventually she just decided to start using the loo. Never looked back.
As a result, with DS, we just let him lead for a while though eventually I did introduce the Poo goes to Pooland app to try to encourage him to use the loo. He backslid for a bit, wanting to use a pull up, but eventually went back to the loo. He did have a phase recently of hanging on too long and going in his pants, but that seems to have stopped after a few months.
2 is tiny really, in fact pretty impressive he is so far along, OP. If he likes wearing pants maybe tell him he will have to go back to pull ups full time if he doesn't tell you when he needs to go so you can put one on him, if you think he is able to understand that?
Or if you notice there is a time he tends to go, maybe pop a pull up on him then?
Otherwise, just wait until this phase passes, and keep encouraging him to use the loo. You could try the Pirate Pete book or Poo goes to Pooland that I mentioned. It comes with impressive farting noises that most toddlers love (but can get a bit wearing when you've listened to it 50 billion times).