greenai.guide

Home › How do I…? › How do I set a compute budget for a research project?

How do I…?

How do I set a compute budget for a research project?

Updated · 1 min read

In short

Estimate the GPU-hours your main experiments need, add a margin for exploration, and track use against that budget like money. Pilot ideas at small scale, stop poor runs early, reuse pretrained models and checkpoints, and report results against the compute they took. A budget makes trade-offs visible and stops endless tuning.

Steps

  1. Estimate GPU-hours for the main experiments and add a stated margin for exploration.
  2. Run small-scale pilots to rule ideas out before scaling up.
  3. Track GPU-hours and energy per experiment against the budget.
  4. Use early stopping for poor runs instead of large grid searches.
  5. Reuse pretrained models and checkpoints where they fit.
  6. Report results against compute, such as accuracy per kWh.

Decide in advance how much computing the project may use, and track it. Without a budget, extra runs feel free, and the energy of a small accuracy gain is never weighed against it.

How do I estimate the budget?

Work from the experiments in your plan: model size, data size and number of runs give approximate GPU-hours. The Green Algorithms calculator from Lannelongue, Grealey and Inouye turns hardware, run time, memory and location into an energy and carbon estimate, which helps you see what the budget means. Add an explicit margin for exploration rather than leaving it open-ended.

What keeps a project inside budget?

  • Small pilots first. Rule out ideas on small models and data subsets.
  • Efficient searches. Stop poor runs early; see cutting the energy of hyperparameter searches.
  • Reuse. Start from pretrained models and saved checkpoints; see avoiding training from scratch.
  • Choose where and on what you run. Patterson and colleagues found that the choice of model, data centre and processor can reduce the carbon footprint of training by up to around 100 to 1,000 times.

Common mistakes

  • Budgeting only the final runs. Exploration is usually most of the compute.
  • No checkpoints, so a failure means starting again.
  • Reporting only best accuracy, which rewards spending more.

The GREENER principles from Lannelongue and colleagues give a framework for groups and institutions. See the guide for researchers.

Sources

  1. GREENER principles for environmentally sustainable computational science, Lannelongue et al., Nature Computational Science (2023)
  2. Green Algorithms: quantifying the carbon footprint of computation, Lannelongue, Grealey and Inouye, Advanced Science (2021)
  3. Carbon emissions and large neural network training, Patterson et al. (2021)

Join us

Help cut AI's impact on the planet

Get new guides, funding calls and directory listings by email, about once a month. Or add your product, course, PhD or research to the directories.

No tracking. Unsubscribe in one click. Other ways to join · Privacy