# Ragas

> Apache-2.0 RAG/agent eval metrics — synthetic data + CI scorers

**Category:** AI Agents  
**Pricing:** open-source  
**URL:** https://www.ragas.io  
**GitHub:** https://github.com/vibrantlabsai/ragas  
**Added:** 2026-09-29

---

## The Hook

Ragas is the Apache-2.0 eval kit for RAG and agent pipelines — faithfulness, context precision, and synthetic test sets without renting an eval SaaS.

## What's Good

Apache-2.0 (explodinggradients/ragas → vibrantlabsai). Python metrics for RAG (faithfulness, answer relevancy, context precision/recall) plus agent/trajectory scorers and synthetic test-data generation. Runs locally or in CI against your own LLM providers. Docs at ragas.io / docs.ragas.io. ★15,869 on GitHub 2026-09-29.

## The Catch

Vs DeepEval (pytest-native agent/chat metrics + Confident AI cloud) and Promptfoo (YAML/CLI red-team): Ragas is RAG-first metric library + synthetic data, not a full red-team harness and not Confident AI dashboards. LLM-as-judge burns provider tokens; cloud extras (if any) are optional — core library stays OSS.

## Verdict

Apache-2.0 RAG/agent eval metrics when faithfulness and context precision beat a hosted eval bill — not DeepEval pytest, not Promptfoo red-team.