Don't know whether to get medium or large. Guy on site wears a medium but it looks skimpy... Any one have any experience of their men's knitwear size-wise? Returns aren't free so want to be sure. Thanks!