My baby is 7 weeks and looks pretty tight with the insert but I think he’s still too small to remove it. He weighs 11lbs. When did you remove yours? Thanks