I think windows open or closed depends on the nature of your house. Tropical and Mediterranean houses often have shutters of large overhangs to keep windows in the shade. We don't have those here, so as much as the outside air starts off warmer, the direct sun on the window glass causes a greenhouse effect and then inside ends up warmed if I don't open the windows.
Also windows open around the house means any breeze can pass through.