What is the context window and why does it matter?

The context window is the maximum number of tokens a model can ‘see’ at once (prompt + response). Larger windows let you include more documents or conversation history, but also increase cost and can dilute attention on key information (‘lost in the middle’ problem). Chunk and retrieve rather than stuffing everything in.