Artificial Intelligence

What is Temperature (AI)?

Quick answer

A setting that controls how random or predictable a language model's output is, with lower values giving more consistent answers.

Temperature (AI), explained

When a model generates text, it chooses each next token from a range of likely options. Temperature adjusts how strongly it favours the most probable choices. A low temperature makes the model pick the safest, most likely words, producing focused and repeatable output. A higher temperature spreads the choice across more options, producing more varied and sometimes surprising text.

In practice, a team extracting invoice totals into a spreadsheet would use a low temperature so the same invoice gives the same result every time. A marketing team brainstorming taglines might raise it to get a wider spread of ideas. Temperature does not make a model more knowledgeable or accurate. Very high values can make output incoherent, and some newer models fix or limit the setting.

Related terms

Guides that mention Temperature (AI)