A setting controlling randomness.
THE DEFINITION
How much randomness is applied when the model selects each word.
WHAT IT DOES
Low: predictable, consistent, conservative output
High: more varied, more creative, less reliable
WHEN TO USE LOW
Factual tasks Extracting structured data Anything requiring consistency Code
WHEN TO USE HIGHER
Creative writing Brainstorming Generating varied options
WHY THE SAME QUESTION GIVES DIFFERENT ANSWERS
Randomness in selection. At a low setting outputs are more consistent but rarely identical.
WHERE YOU SET IT
In API access, and in some interfaces offering advanced options.
Most chat interfaces set a default and do not expose it.
PRACTICAL ADVICE
If output is erratic, lower it. If it is repetitive and dull, raise it.
RELATED TERMS
API, inference, prompt.
