So on Monday, if he tells you that he’s taking your baby to a different country for a week (if he’s even from a different country - based on information so far, he could be completely British for 3+ generations) without you, you’ll be fine with that? You pushed him into a situation where his only choice if he wanted to be with his wife and newborn was to face people that he knows don’t like him for his race, and trust me, my husband (half-black) says you can ALWAYS tell. Whether they’re rude as fuck or sweet as pie, if the racist shite is within them, it always comes out eventually. So you see your dad giving him polite advice, and he sees a man he already knows doesn’t approve of him just disapproving of one more thing he does, no matter how it’s phrased.
But you are going to have to choose quickly when fights like that happen: your husband or your parents. You should have been following your husband out the door and telling your parents you’d call them later once this got figured out. Instead, you staying allowed them to have open season on him.
Because somehow I’m guessing if you’d married a man they approved of (Irish, English, white, Catholic, Protestant, whatever it is they wanted), that instead of telling you this “behavior” is controlling, it would have been, “Oh bless, he doesn’t want to be away from his little princess for a week.” 
Talk to your husband. Ask him how he feels and interprets what happened, listen, and then figure out how to be a team, or your parents will eventually separate your marriage.