Usage caps and restrictions.
WHAT LIMITS EXIST
Messages per period Length of input Length of output File size and number Rate of requests
WHY THEY EXIST
Running these models is computationally expensive. Limits manage capacity and cost.
WHAT HAPPENS WHEN YOU HIT ONE
You wait, or upgrade, or the request fails.
CONTEXT LIMITS
The most consequential. Everything the model considers must fit: your input, the conversation history, and its output.
Beyond that, earlier content is dropped.
WHAT THAT LOOKS LIKE
An assistant that appears to forget the beginning of a long conversation.
WHAT TO DO
Start a new conversation for a new topic Restate important constraints in long exchanges Split very long documents
OUTPUT LIMITS
Why responses sometimes stop mid-sentence.
Ask it to continue.
FOR API USE
Rate limits and token costs matter more and need planning.
