Dear HH, your stbx (sounds good, doesn't it), is doing all this not because he loves and cares about his daughter but only to hurt you. I do not think that he wants to spend too much time with her, so I would not be surprised if he himself did not suggest a change of schedule at some point so that she ends up being with you more, once he realized how much work it actually is taking care of a child.
The way he is acting right now, no, he can never endanger your position in your daughter's life. He is mean and spiteful and does not put her needs before his and she feels this even though she is so young still. Once you are out of that house and have your own life you will feel a lot better and the pressure that you are feeling will lessen. Yes, the adjustment around your DD schedule will take time, but soon enough you will get into the rhythm and all will fall in place.
Unfortunately you cannot change what he does and what happens at his house, so focus your attention on yours. Make sure that you give your DD what she needs when she is with you. More then anything, I think, she needs to know that you are ok. She needs stability and certainty, love and attention, so I think it is most important for both of you now that you try, as much as you can, not to be to upset with your stbx gimmicks. Like other posters said, do not show him how much you care about certain things, how much it upsets you. But like I said this will all be easier once you are out of that house. Good luck to you. Hugs. 