Alternatives · Memory & Evals
AX Check alternatives (2026)
AX Check: Free hosted AX smoke test. Grades how agents use your product, not how good your model is.
Its Catch: Grades are provisional and technical-only — treat the report as a useful first pass, not a product-wide quality certificate.
Below: 8 free or free-tier tools from the same category (agent memory tools), free and open source first, then the closest match by shared tags. Each keeps its own Catch.
Free / OSS · OSS/MIT · 7.4k GitHub stars
VerdictMIT agent memory primitive. MCP/CLI/TUI on SQLite; not a full agent framework.
CatchVs Mem0 / Letta / full agent frameworks: Engram is the memory primitive (store + retrieve + surfaces), not an orchestration framework or coding agent. “local or cloud” branding means optional hosted/sync gravity — day-one stays OSS you run. You still decide what gets written and when.
Free / OSS · OSS/MIT · 5.4k GitHub stars
VerdictThe most complete plain-Markdown memory setup for Claude Code and friends — free, but opinionated and Obsidian-bound.
CatchIt is opinionated about work life — standups, 1:1s, brag docs, incident capture — so it fits people who want an agent-run work journal, not just a project memory file. Needs Obsidian 1.12+ (a free but closed-source app) with its CLI enabled, plus Node 22+. QMD downloads about 2 GB of local models on first use. Hooks run on every session and message, so read them before you trust a vault. Vs mem0 or Letta: those are memory layers you build into an app; this is a personal vault for your own coding agent.
Free / OSS · OSS/MIT · 68 GitHub stars
VerdictMIT self-hosted memory MCP. Use when coding agents need durable local memory without Mem0 Cloud.
CatchVs Mem0 / Letta / Graphiti: Friday is the self-hosted MCP memory appliance for coding agents, not a multi-tenant memory API or a full agent OS. You operate Neo4j/Compose and embedding/model keys; star count is still early — pin and verify before production trust.
Free / OSS · OSS/MIT · 28k GitHub stars
VerdictThe task memory to give a coding agent once its plans outgrow a markdown file — try --stealth first on repos you share.
CatchIt runs on Dolt, a version-controlled SQL database: the default embedded mode allows a single writer, and several concurrent writers need a separate dolt sql-server. bd init edits AGENTS.md and installs Claude Code, Codex and Cursor integrations by default — pass --stealth or --skip-agents on shared repos. Upgrades that cross a schema migration need one clone to migrate and the rest to bootstrap, and the HTTP backend is still experimental. Stars have grown fast (about 530 a week since the repo opened in Oct 2025), so judge it on a trial run, not the count.
Free / OSS · Freemium · 26.1k GitHub stars
VerdictMIT eval/red-team CLI. Free core; probe cap + Enterprise sales wall.
CatchVs DeepEval/Braintrust: YAML/CLI-first, not pytest-native Python or Braintrust SaaS. Community caps red-team probes (~10k/mo); Enterprise/On-Prem are contact-sales (SSO, dashboards, dedicated runner). LLM API costs are yours. Acquisition governance is a multi-year bet.
Free / OSS · OSS/MIT · 6.2k GitHub stars
VerdictMIT local agent archive. Session/cost on disk; not Langfuse/Braintrust cloud.
CatchVs Langfuse / Braintrust (cloud LLM observability): agentsview is a local session/cost archive for coding-agent transcripts, not a hosted tracing/eval platform. Optional anonymous telemetry ping; you still need the agent logs on disk. Not a replacement for production OpenTelemetry of your app’s LLM calls.
Free / OSS · OSS/MIT · 3.4k GitHub stars
VerdictMIT Hermes-agent tooling. Niche, not a multi-host skill pack.
CatchHermes-specific — not a generic Claude Code / Codex skill pack. Young surface; expect Hermes Agent as the host and follow upstream Hermes breaking changes. Vs ECC (multi-host ecosystem) and security-audit-skill (Cloudflare audit skill): oh-my-hermes is niche Hermes tooling, not a cross-harness coordination layer or a security scanner.
Free / OSS · OSS/MIT · 49.2k GitHub stars
VerdictMIT personal agent runtime. Self-host when you want MCP + memory + chat bridges in a small Python core.
CatchYou operate the host, keys, and chat-app credentials; “ultra-light” still means a long-running service. Young surface with a large issue backlog — pin versions for production. Vs OpenHands / LibreChat (heavier coding or multi-model chat stacks) and OpenBot (governed coworker computers): nanobot is the small personal gateway, not a full browser-cowork platform or a repo-coding agent.
FAQ
- What are the best free alternatives to AX Check?
- Engram, Obsidian Mind, Friday, Beads, Promptfoo. All are reviewed on Stack Gems in the same category (agent memory tools); 8 free or open source.
- What is the catch with AX Check?
- Grades are provisional and technical-only — treat the report as a useful first pass, not a product-wide quality certificate.
- Is there an open-source alternative to AX Check?
- Yes: Engram (OSS/MIT), Obsidian Mind (OSS/MIT), Friday (OSS/MIT), Beads (OSS/MIT).