What are the best free alternatives to LangSmith?

Arize Phoenix, Opik, LangWatch, Laminar, OpenLIT. All are reviewed on Stack Gems in the same category (LLM eval and tracing tools); 8 free or open source.

Is there an open-source alternative to LangSmith?

Yes: Arize Phoenix (Open-Core), Opik (Apache-2.0), LangWatch (Apache-2.0), Laminar (Apache-2.0).

Alternatives · Evals & Tracing

LangSmith alternatives (2026)

LangSmith: Freemium LangChain obs/eval when the LangGraph stack wants one vendor pane — not Langfuse MIT self-host; free until ~5k traces.

Its Catch: The product is hosted freemium (self-host exists on higher plans) — not a MIT self-host default like Langfuse.

Below: 8 free or free-tier tools from the same category (LLM eval and tracing tools), free and open source first, then the closest match by shared tags. Each keeps its own Catch.

1.Arize PhoenixELv2 self-host AI observability & eval — traces, datasets, playground
Free / OSS · Open-Core · 11.9k GitHub stars
VerdictELv2 self-host AI obs/eval when Phoenix’s tracing+evals fit and you accept source-available — not Langfuse MIT, not Braintrust CI-eval.
CatchNOT OSI open source — ELv2 forbids offering Phoenix as a competing hosted SaaS. Vs Langfuse (MIT full-stack self-host) and Braintrust (eval-first freemium): Phoenix is Arize’s ELv2 observability/eval kit with strong notebook/embedding UX, not MIT and not Braintrust’s CI-eval product. Arize cloud is the upsell when you want managed multi-tenant.
2.OpikApache-2.0 LLM and agent tracing, evaluation and monitoring by Comet
Free / OSS · Apache-2.0 · 22.7k GitHub stars
VerdictA strong self-hostable Langfuse alternative with evals built in — choose it if CI evaluation matters most to you.
CatchSelf-hosting is a multi-service stack, not a single binary, so budget ops time or use Opik Cloud, Comet's hosted version with its own free tier and paid plans. README and docs links lean toward Comet sign-up. It overlaps heavily with Langfuse and Phoenix, so pick one tracing backend per project.
3.LangWatchApache-2.0 LLM tracing, agent tests, evals, gateway
Free / OSS · Apache-2.0 · 5k GitHub stars
VerdictWorth a look if you want agent tests and an LLM gateway in the same tool as your traces.
CatchIt tries to be four products at once, so expect a broad surface that overlaps with Langfuse, Opik and LiteLLM. The production self-host is more than a single Node process. The managed LangWatch Cloud is the commercial path, and README links lean that way.
4.LaminarApache-2.0 tracing, evals and signals for AI agents
Free / OSS · Apache-2.0 · 3.4k GitHub stars
VerdictStrongest pick when you trace browser and computer-use agents.
CatchSelf-hosting is a multi-service stack. Signals run an LLM over your agent runs, which adds cost and sends trace content to a model. The hosted Laminar cloud is the main product path. Crowded space next to Langfuse, Opik and LangWatch.
5.OpenLITApache-2.0 OTel tracing, evals and guardrails for agents
Free / OSS · Apache-2.0 · 2.9k GitHub stars
VerdictA solid self-hosted LLM observability option, especially if you also watch GPU cost.
CatchThe README is heavy on the new agent-harness-engineering framing; underneath it is an OTel tracing and eval platform in a crowded field. Self-hosting means running its UI and ClickHouse. Many repos and releases (SDKs, collectors) to keep in sync.
6.RagasApache-2.0 RAG/agent eval metrics — synthetic data + CI scorers
Free / OSS · Apache-2.0 · 16.1k GitHub stars · quiet 180d+
VerdictApache-2.0 RAG/agent eval metrics when faithfulness and context precision beat a hosted eval bill — not DeepEval pytest, not Promptfoo red-team.
CatchVs DeepEval (pytest-native agent/chat metrics + Confident AI cloud) and Promptfoo (YAML/CLI red-team): Ragas is RAG-first metric library + synthetic data, not a full red-team harness and not Confident AI dashboards. LLM-as-judge burns provider tokens; cloud extras (if any) are optional — core library stays OSS.
7.HolmesGPTApache-2.0 CNCF AI agent for production incidents
Free / OSS · Apache-2.0 · 3.6k GitHub stars
VerdictThe most credible open SRE agent — start read-only and keep a human in the loop.
CatchIt needs read access to your infrastructure and observability data and sends that context to the LLM you configure, so pick the provider and scope permissions with care. Root-cause suggestions can be wrong and need human review, and letting it open PRs is a step to take deliberately. LLM costs scale with investigation volume.
8.e2e (TesterArmy)Apache-2.0 agent-driven e2e tests for web and mobile — replays without model calls
Free / OSS · Apache-2.0 · 11.3k GitHub stars
VerdictApache agentic e2e when flaky selectors cost more than tokens — record-and-replay keeps CI cheap; pin minors and turn telemetry off.
CatchTelemetry: the CLI sends anonymous usage data by default — `npx e2e telemetry disable` or `E2E_TELEMETRY_DISABLED=1`. Pre-1.0: APIs and config can change between minors. Built by TesterArmy, a commercial agentic-testing platform; Kernel hosted browsers and EAS simulators are optional paid add-on engines. Vs stagehand (browser automation SDK) and playwright (deterministic runner): e2e is a test framework that mixes agent steps with assertions and caches them.

FAQ

What are the best free alternatives to LangSmith?: Arize Phoenix, Opik, LangWatch, Laminar, OpenLIT. All are reviewed on Stack Gems in the same category (LLM eval and tracing tools); 8 free or open source.
What is the catch with LangSmith?: The product is hosted freemium (self-host exists on higher plans) — not a MIT self-host default like Langfuse.
Is there an open-source alternative to LangSmith?: Yes: Arize Phoenix (Open-Core), Opik (Apache-2.0), LangWatch (Apache-2.0), Laminar (Apache-2.0).

LangSmith alternatives (2026)

FAQ

More