greenai.guide

Home › How do I…? › How do I set a baseline to prove AI energy savings?

How do I…?

How do I set a baseline to prove AI energy savings?

Updated · 1 min read

In short

Measure the current system before you change anything, on the same hardware, load and inputs you will use afterwards, and repeat the runs to see the normal spread. Report energy per unit of useful work as well as in total, and only claim a saving bigger than the noise and achieved without a drop in quality.

Steps

  1. Choose a functional unit, such as energy per request or per document.
  2. Measure the current system several times on a fixed set-up and workload, including the idle baseline.
  3. Change one thing at a time and re-measure under the same conditions.
  4. Record quality or task success alongside energy for each run.
  5. Claim only savings larger than the run-to-run spread, and report totals as well as per-unit figures.

A saving only counts if you measured before, measured after the same way, and the difference is bigger than the noise. Without a baseline, an energy claim is a guess, and it may not survive scrutiny.

What makes a fair comparison?

  • Same set-up: hardware, region, software versions and settings.
  • Same load: the same requests, documents or training data, at the same volume.
  • Several runs: readings vary with temperature, background processes and frequency scaling. Report the mean and range.
  • Energy, not just speed: the GreenCode Constitution work found, on the llama.cpp inference engine, a 4.7% cut in GPU energy alongside only a 3% speed gain. Time and energy can tell different stories.
  • Quality held: a cheaper answer that is wrong more often is not a saving.

Which unit should the baseline use?

Use a functional unit, as in the Green Software Foundation's SCI specification: per request, per document, or per successful task. Then report the total alongside it, because energy per task can fall while total energy rises as use grows. See tracking AI energy per task.

Common mistakes

  • Measuring once, before and after. One pair of readings can be noise.
  • Changing several things at once, so you can't tell what helped.
  • Moving the baseline, for example comparing a new small model with an old large one at a different volume.
  • Counting carbon falls that come only from a cleaner grid as efficiency.

Before you publish a saving, check it against honest green claims.

Sources

  1. Software Carbon Intensity (SCI) specification, Green Software Foundation (2024)
  2. GreenCode Constitution: agent principles for optimizing code and LLM inference energy use, Kapenekakis, Kim, Ionescu, Thomsen and Albano, GreenAI workshop, ECML PKDD 2026 (2026)

Join us

Help cut AI's impact on the planet

Get new guides, funding calls and directory listings by email, about once a month. Or add your product, course, PhD or research to the directories.

No tracking. Unsubscribe in one click. Other ways to join · Privacy