My DD is 12 weeks now, so this is fresh in my mind.
I was tired, and getty ratty at DH for either being too rough or too precious when doing, in my mind, simple tasks like dressing and nappy changes. I would step in, or hover over, and get even more stressed. I found I was tired and starting to get frustrated with DD as lack of sleep was giving me little patience.
In order to change this, I have had to have a firm talking to myself. I started by putting all her changing stuff in her bedroom (we live on one floor) so if DH did nappy changes or got her dressed, he took her away to do it, and I didnt follow/couldnt see. I wouold also take an hour out to go to bed, not to sleep, but a bit of TV or something, while he was on a day off. If I heard her crying, I stayed put. It was hard, but he needed to learn how to comfort her and she needed to learn to be comforted by him.
Your OH is probably feeling tense as well, as he will want to get things right so it's easier for you, but if he feels like his efforts are being underminded then he'll do less and less as his confidence lowers. I found also by saying things like "when I feed her, I generally do X" and "these vests are great, you can pull them down as well as up over her body" rather than "you should be doing X" or "why on earth are you doing that?" was effective as it was more advice rather than nagging.
Try and find a little time for yourself. It will give you the headspace and also your OH the bonding time. For us, it was in the morning. DH would get up half an hour before usual (for work) and get our DD up with him. He'd feed her, change her and have a little play while I slept, and then he would drop her back in her cot in our room to go back to sleep and get himself off to work. I'd have slept through this time, so when she woke, I was more refreshed. Plus, he got a bit of time to be responsible for her.