iFixAi
Apache-2.0 agents eval/audit — pip install, premium ≠ paywall
AI Agents / Memory & Evals · Apache-2.0 · 29.7k
Reviewed 2026-10-01 · last push 2026-10-16 · repo checked 2026-10-19
What's Good
Apache-2.0 (ifixai-ai/iFixAi). PyPI `ifixai` (HTTP 200). Premium tiers exist but are not a paywall for the OSS bar — bring your own runs and scorers. Aimed at operators who need eval/audit loops beside the agent harness, not another hosted pane.
The Catch
Vs Braintrust / Langfuse / Ragas / Promptfoo: Braintrust is eval-first commercial; Langfuse is MIT obs/self-host; Ragas is Apache RAG/agent metrics + CI scorers; Promptfoo is OSS prompt/agent eval — iFixAi’s catch is agents eval/audit as an installable audit kit, not Braintrust seats, not Langfuse traces, not Ragas metrics alone, not Promptfoo prompt suites. Stars grow fast (~47 a week): judge the audit loop, not the counter.
Verdict
Apache agents eval/audit when you want pip-installable scoring without an eval SaaS gate — not Braintrust/Langfuse/Ragas/Promptfoo’s lanes; premium ≠ required.
Embed
Maintainer? Add the badge to your README. It is free, links to this review, and there is no paid version.
Markdown
[](https://stackgems.com/gems/ifixai)
HTML
<a href="https://stackgems.com/gems/ifixai"><img src="https://stackgems.com/badge/ifixai.svg" alt="iFixAi reviewed on Stack Gems" height="20"></a>
Related
AI Agents →- Mem0Memory infrastructure for AI agents that actually persists
- LangfuseOpen-source LLM observability you can self-host
- LettaEpisodic memory for agents that think across sessions
- PromptfooMIT LLM evals & red-teaming CLI; Community free, 10k probes/mo
- DeepEvalApache-2.0 pytest-style LLM/agent evals; Confident AI is the paid cloud