My baby boy is 6 weeks old, and although I really want to carry him, I have been struggling with slings. I have now got an Ergo with infant insert and I think it will work for us. But how long can I keep him in it? If I go and meet my NCT friends for a coffee, can he be the whole time in it?