"I will be asking him if he plans on going on annual trips abroad with friends because that is not something i will put up with"
OK, I get where you're coming from here, but that just sounds really bossy.
He's a 23 year old man without children, so going on foreign holidays with his friends is something that it pretty normal for him to want to do and expect to be able to do.
You are a 23 year old woman with a 3 year old daughter, so foreign holidays with friends are not so easily achievable for you.
But the problem is that you have a live-in BOYFRIEND.
It doesn't really sound like he is committed to you and your daughter as a partner/stepdad, but that he loves you as a boyfriend and loves your daughter too.
Which, given his age, is entirely reasonable. It doesn't make him a bastard.
But of course, live-in boyfriends and small children don't really go together, because it puts you and him in completely different positions - you think "family" and he thinks "sex on tap at home, still loads of time with my mates".
TBH I think having him move in with you was probably a mistake, and I'd be reconsidering that arrangement.
You don't have to break up if you still love each other, but right now you don't want the same things and I can't see any way for both of you to be happy as domestic partners.