What Is a Context Window? The Model's Working Memory
DICTIONARY · AI

What Is a Context Window?

The context window is the total amount of text a model can consider at once: your instructions, the material, and the conversation so far.

In plain English

It is working memory, measured in tokens. Everything the model can take into account has to fit inside it, and when it fills, the earliest content falls out of view.

Larger windows are genuinely useful, but attention is not uniform across a long context. Material at the start and end is used more reliably than material buried in the middle.

What to know

Measured in tokens
Both what you send and what the model generates count towards it.
Shared budget
System prompt, documents, conversation history and the answer all compete.
Uneven attention
Beginning and end are used more reliably than the middle.
Overflow
Exceeding it means truncation, not an error you always notice.

Why it matters

Most complaints that a model forgot something are context window problems. Knowing the limit changes how you structure long work: summarise and restate rather than assuming a fifty-message thread is all still in view.

Common mistakes

×Assuming a long conversation retains everything from the start.
×Pasting an entire document when the relevant section would do.
×Burying the most important instruction in the middle of a long prompt.
×Ignoring that output tokens also consume the budget.

FAQs

Is a bigger context window always better?

It helps, but relevance beats volume. Retrieval usually outperforms pasting everything.

What happens when I exceed it?

Earlier content is dropped or the request fails. Either way, quietly.

WRITTEN BY TARIQ SALLAM
Marketing Consultant. Entrepreneur. Content Creator.

I'm a marketing consultant, entrepreneur and content creator. I help businesses grow through practical marketing, websites, SEO, content and AI.

More About Tariq →