# Hugging Face Community Evals

> Local inspect-ai and lighteval

**Subcategory:** Hugging Face  
**License:** Apache-2.0  
**Source:** https://github.com/huggingface/skills/blob/main/skills/huggingface-community-evals/SKILL.md

---

## When it is useful

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

## The Catch

local inspect-ai/lighteval. Not HF Jobs.