There was an interesting piece on radio 4 this morning, a woman (sorry I forget who) had written a book sighting evidence that it was actually much better for small children to have stability and visits in their own home if possible - food for thought if you think you can handle it.
As for the timings - he needs to fit in around the children's routines really. If she goes to bed at 7, he needs to be there before and put her to bed himself. The morning seems a bit mad - if he's not a morning person is he really going to make it that often??
Whatever happens, neither of you HAVE to agree anything just because the other one says. Neither do you HAVE to prove anything - this is him being ridiculous.
If he is in agreement to you being primary carer, and the children living with you, then he has to accept that you have more of a degree of control - and so do you, so exercise it!! Do what's best for the kids. Little and often is a good thing, but not at the complete expense of their routine.
Unfortunately, my ex still struggles with this part on occasion, and feels he should be able to do as he pleases without agreeing with me first. He particularly gets angry if I don't agree. But that is the situation - you can disagree, and you can propose other arrangements. It would be best if you could compromise and come to an agreement, but if he won't you shouldn't feel that you have to do what he wants, you can put your foot down.