My ex called asking where I was because he wanted to pick up our daughter and take her somewhere. I told him I was busy and that he'd have to take her out another day. He insisted on knowing where I was, but I said it didn't matter since I was out. He got annoyed and said he has a right to know where his daughter is, even though I'm the main caregiver and he only sees her once a week. He then threatened that if I don't tell him where I am, he won't inform me about where he's taking her. Eventually, I hung up, and he continued this conversation by sending condescending messages. I am right to set these boundaries, aren't I? He doesn't need to know my whereabouts since that's private information, and he's overstepping.