Higress

Apache-2.0 AI and API gateway on Envoy and Istio, with Wasm plugins, model proxying and MCP hosting

AI Agents / AI Gateway · Apache-2.0 · 9.6k

Reviewed 2026-10-11 · last push 2026-10-17 · repo checked 2026-10-19

What's Good

Apache-2.0 (higress-group/higress), release v2.2.5. Built on Envoy and Istio, extended with Wasm plugins you can write in Go, Rust or JS. Proxies many model providers behind one endpoint with token rate limiting, fallback and caching, and can host MCP servers or turn existing REST APIs into MCP tools. Runs on Kubernetes or as a standalone Docker deployment. ★~9.5k.

The Catch

It is a full Envoy/Istio gateway, much heavier to run than a single-binary model proxy. Default images pull from an Alibaba Cloud registry in Hangzhou, so outside China switch to the US or Southeast Asia mirror if pulls time out. Much of the documentation and the plugin catalog live on higress.cn. Vs agentgateway (a lighter, purpose-built gateway for agent and MCP traffic) and litellm (a Python model proxy you can start in minutes): Higress fits when you want AI traffic inside a production API gateway you already run at scale.

Verdict

A production-grade AI gateway if you can run Envoy and Istio — for a quick model proxy, start with something smaller.

Embed

Maintainer? Add the badge to your README. It is free, links to this review, and there is no paid version.

Markdown

[![Reviewed on Stack Gems](https://stackgems.com/badge/higress.svg)](https://stackgems.com/gems/higress)

HTML

<a href="https://stackgems.com/gems/higress"><img src="https://stackgems.com/badge/higress.svg" alt="Higress reviewed on Stack Gems" height="20"></a>

AI Agents →

Related