Trousers (not jeans), smart jumper/top, healed boots (with warm socks), warm coat, nice scarf, gloves.
Boxes are usually warm but you may be expected to actually sit outside and watch the game!
If you're not a football fan I would also recommend a hat and some discreet headphones so that you can listen to radio/music/audiobook.