{"data":{"slug":"ragas","name":"Ragas","tagline":"Apache-2.0 RAG/agent eval metrics — synthetic data + CI scorers","category":"agents","categoryName":"AI Agents","url":"https://www.ragas.io","github":"https://github.com/vibrantlabsai/ragas","pricing":"open-source","hook":"Ragas is the Apache-2.0 eval kit for RAG and agent pipelines — faithfulness, context precision, and synthetic test sets without renting an eval SaaS.","whatsGood":"Apache-2.0 (explodinggradients/ragas → vibrantlabsai). Python metrics for RAG (faithfulness, answer relevancy, context precision/recall) plus agent/trajectory scorers and synthetic test-data generation. Runs locally or in CI against your own LLM providers. Docs at ragas.io / docs.ragas.io. ★15,869 on GitHub 2026-09-29.","theCatch":"Vs DeepEval (pytest-native agent/chat metrics + Confident AI cloud) and Promptfoo (YAML/CLI red-team): Ragas is RAG-first metric library + synthetic data, not a full red-team harness and not Confident AI dashboards. LLM-as-judge burns provider tokens; cloud extras (if any) are optional — core library stays OSS.","verdict":"Apache-2.0 RAG/agent eval metrics when faithfulness and context precision beat a hosted eval bill — not DeepEval pytest, not Promptfoo red-team.","addedAt":"2026-09-29","featured":false,"domain":"AI Agents","subSpecialty":"Agents","subcategory":"Evals & Tracing","tags":["self-host","local-first","permissive","rag","evals","observability","testing","stale"],"capabilities":["ci"],"surfaces":["Self-host","Hosted"],"ecosystem":["Multi-platform"],"licenseModel":"Apache-2.0","githubStars":16067,"starsPerWeek":89,"access":"free","archived":false,"repo":{"createdAt":"2023-05-08","pushedAt":"2026-02-24","license":"Apache-2.0","archived":false,"checkedAt":"2026-10-19"}},"related":[{"slug":"claude-code","name":"Claude Code","tagline":"Terminal-first coding agent with deep repository context"},{"slug":"cursor","name":"Cursor","tagline":"The AI-first code editor that understands your codebase"},{"slug":"devin","name":"Devin","tagline":"Autonomous AI engineer for defined engineering tasks"},{"slug":"stagehand","name":"Stagehand","tagline":"AI-native browser automation that mixes code and natural language"},{"slug":"browser-use","name":"Browser Use","tagline":"Open-source framework for LLM-driven browser agents"}],"links":{"self":"/api/gems/ragas","html":"/gems/ragas","markdown":"/gems/ragas.md","category":"/api/gems?category=agents","categoryPage":"/stacks/agents"}}