greenai.guide

Home › How do I…? › How do I find a task-specific model instead of using a general chatbot?

How do I…?

How do I find a task-specific model instead of using a general chatbot?

Updated · 1 min read

In short

Name the task precisely, then search a model hub such as Hugging Face by task type and test two or three small candidates on your own examples. A model built for one job can be orders of magnitude cheaper to run than a general generative model doing the same job, so it is worth an afternoon of testing before you settle on a chatbot.

Steps

  1. Describe the task in one line, such as "sort support emails into six categories".
  2. Search a model hub filtered by that task type, for example text classification or translation.
  3. Shortlist two or three small models and check their licences and languages.
  4. Test each one on 50 to 100 of your own real examples with a pass mark.
  5. Compare energy per request where a rating exists, and keep a general model only for the cases that fail.

For well-defined jobs, a model trained for that job is usually cheaper and often just as good. A general chatbot pays, on every request, for abilities your task never uses.

Why does it matter?

Luccioni, Jernite and Strubell compared many models across common tasks and found multi-purpose generative models orders of magnitude more expensive to run than task-specific systems for the same tasks. UNESCO and University College London report that small task-specific models can cut energy use by up to 90%.

Where do I look?

Start with a public model hub and search by task, not by brand. Hugging Face, for example, lets you filter models by task such as text classification, named-entity recognition, summarisation, translation or speech recognition. Look for:

  • models fine-tuned on data similar to yours (same language, same kind of text);
  • a clear model card saying what it was trained on and how it was evaluated;
  • a size you can afford to run, measured in parameters.

For comparing energy, the AI Energy Score rates models on GPU energy for ten common tasks, from one to five stars.

Common mistakes

  • Judging on public benchmarks alone. Test on your own examples; that is the only score that matters to you.
  • Asking a chatbot to do bulk classification. If you are labelling thousands of items, a small classifier is faster and cheaper.
  • Forgetting the fallback. Keep a larger model for the hard cases, and see how to route requests to smaller models.

For the full method, read choose the right model.

Sources

  1. Power Hungry Processing: Watts Driving the Cost of AI Deployment?, Luccioni, Jernite and Strubell, ACM FAccT (2024)
  2. Smarter, smaller, stronger: resource-efficient generative AI and the future of digital transformation, UNESCO and University College London (2025)
  3. AI Energy Score, Hugging Face (2025)

Join us

Help cut AI's impact on the planet

Get new guides, funding calls and directory listings by email, about once a month. Or add your product, course, PhD or research to the directories.

No tracking. Unsubscribe in one click. Other ways to join · Privacy