greenai.guide

Home › How do I…? › How do I make my company's AI use more sustainable?

How do I…?

How do I make my company's AI use more sustainable?

Updated · 1 min read

In short

Start by mapping where your company uses AI, then make the efficient choice the default: the smallest model that meets the quality bar, short outputs, AI features off unless needed. Ask suppliers for energy per request and where they run, measure per useful task, and put it in a short policy with an owner. Most of these steps cut cost and delay as well as energy.

Steps

  1. List the AI tools, features and automated workflows in use and roughly how often each runs.
  2. Test whether a smaller model or a non-AI method meets the quality bar for your highest-volume tasks.
  3. Set efficient defaults in company tools, such as smaller models, output limits and features off unless needed.
  4. Ask suppliers for energy per request, where workloads run and how they report it.
  5. Track energy or tokens per useful task and review the figures every quarter.
  6. Write the rules into a short policy with a named owner and a review date.

Make the efficient choice the default, then measure whether it is working. For most companies the energy is in running models (inference) many times a day, not in training them, so everyday choices about models, prompts and features matter most.

Two findings show how much room there is. Luccioni, Jernite and Strubell found general-purpose generative models orders of magnitude more expensive to run than task-specific ones for the same tasks. UNESCO and University College London found that smaller, task-specific models could cut energy use by up to 90%, and shorter prompts and responses by more than half.

Where do I start?

  1. Map your AI use: see how to map where your organisation uses AI.
  2. Right-size the busiest tasks: try small models first; see choose a smaller AI model.
  3. Set defaults: switch off features nobody uses; see switch off unneeded AI features.
  4. Ask suppliers: see sustainability in AI procurement.
  5. Measure per task: see track AI energy per task.
  6. Write it down: see write a green AI policy.

What makes the biggest difference

Model choice on high-volume tasks, and turning off AI that runs without anyone needing it. Staff habits matter, but defaults reach everyone without relying on memory.

Common mistakes

  • Counting cost per call instead of per successful task, so retries stay hidden.
  • Treating a green cloud contract as the whole answer while usage keeps growing.
  • Claiming savings before measuring a baseline.

The full approach is in our guide for business.

Sources

  1. Smarter, smaller, stronger: resource-efficient generative AI and the future of digital transformation, UNESCO and University College London (2025)
  2. Power Hungry Processing: Watts Driving the Cost of AI Deployment?, Luccioni, Jernite and Strubell, ACM FAccT (2024)

Join us

Help cut AI's impact on the planet

Get new guides, funding calls and directory listings by email, about once a month. Or add your product, course, PhD or research to the directories.

No tracking. Unsubscribe in one click. Other ways to join · Privacy