greenai.guide

Home › How do I…? › How do I know when to use an AI "thinking" or reasoning mode?

How do I…?

How do I know when to use an AI "thinking" or reasoning mode?

Updated · 1 min read

In short

Use a reasoning or "thinking" mode for genuinely hard problems, such as multi-step maths, tricky code or careful analysis, and a standard or fast model for everyday questions, drafting and summaries. Reasoning modes write long hidden chains of working before answering, and one benchmark found they used on average 30 times more energy.

Steps

  1. Start with the standard or fast model for everyday questions and writing.
  2. Switch to a reasoning mode when the task needs several logical steps or careful checking.
  3. Turn reasoning off again once the hard part is done.
  4. Check whether your app chooses the mode automatically, and override it for simple tasks if you can.

Reasoning modes are for hard problems, not for every question. A "thinking" model works through a problem step by step before it answers, writing out many hidden tokens of working. That can improve answers on difficult tasks, but it costs far more computation.

How much more energy does reasoning use?

A lot more, on the evidence so far. Hugging Face's AI Energy Score team tested open models in late 2025 and found that reasoning models used, on average, 30 times more energy. When the same model was run with reasoning switched on and off, it used between 150 and 700 times more energy with reasoning enabled, and produced between 300 and 800 times more tokens. These are tests of open models on standard tasks; commercial services do not publish comparable figures.

Kim, Shin, Chung and Rhu found a related pattern for "test-time scaling" more generally: spending more computation per answer gave diminishing returns in accuracy.

When is it worth it?

Task Usually enough Reasoning helps
Quick facts, rewording, emails Standard or fast model Rarely
Summaries and first drafts Standard model Rarely
Multi-step maths or logic Sometimes Often
Debugging tricky code Sometimes Often
Weighing a complex decision Standard model to start When the first answer is shallow

Common mistakes

  • Leaving reasoning on all the time because it feels "smarter".
  • Using it for creative writing or simple rewrites, where it rarely helps.
  • Not checking automatic mode-switching. Some apps decide for you; see whether you can choose.

For choosing models more generally, see choose a smaller AI model and choose the right model.

Sources

  1. AI Energy Score v2: refreshed leaderboard, now with reasoning, Luccioni and Gamazaychikov, Hugging Face (2025)
  2. The cost of dynamic reasoning: demystifying AI agents and test-time scaling from an AI infrastructure perspective, Kim, Shin, Chung and Rhu, HPCA 2026 (2025)

Join us

Help cut AI's impact on the planet

Get new guides, funding calls and directory listings by email, about once a month. Or add your product, course, PhD or research to the directories.

No tracking. Unsubscribe in one click. Other ways to join · Privacy