What Is Temperature in AI? The Creativity Dial
Remember how LLMs predict the next word? At each step, the model doesn’t just pick one word — it calculates probabilities for thousands of possible next words. Temperature is the setting that controls how the model chooses among those possibilities.
The Dial Explained
Imagine the model is choosing the next word after “The weather today is”:
- “sunny” — 40% probability
- “nice” — 25% probability
- “beautiful” — 15% probability
- “chaotic” — 2% probability
At low temperature, the model almost always picks “sunny” — the safest, most likely choice. At high temperature, it might pick “chaotic” — surprising, creative, but less predictable.
Low temperature: "The weather today is sunny and warm."
High temperature: "The weather today is chaotic, like a symphony of clouds."What the Numbers Mean
Temperature is set as a number, typically starting at 0. The exact range depends on which AI provider you’re using — some use 0 to 1, others 0 to 2 — but the concept is the same everywhere:
- Temperature 0 — Nearly deterministic. The model picks the top choice almost every time. Best for tasks where consistency matters.
- Low temperature (0.1-0.3) — Focused and reliable. Good for factual questions, data extraction, and analysis.
- Medium temperature (0.4-0.7) — Balanced. Good for general conversation and writing tasks.
- High temperature (0.8+) — Creative and varied. Good for brainstorming, poetry, and storytelling.
When to Adjust It
Most of the time, you won’t need to touch temperature — default settings work well for general use. But knowing it exists helps in specific situations:
Turn it down when you need accuracy, consistency, or are doing anything analytical. If you’re asking the model to classify data, extract information, or answer factual questions, low temperature keeps it focused.
Turn it up when you want variety. If the model keeps giving you the same stale opening line, raising the temperature can help it explore more creative options.
Where to Find It
In chat interfaces like ChatGPT or Claude.ai, temperature is usually set automatically. You’ll find temperature controls in API settings, AI playgrounds, and some advanced chat settings.
Temperature is one piece of the puzzle. The next snack covers a very different kind of AI behavior — one that’s less a feature and more a risk: what happens when the model makes things up.