{"data":{"slug":"vllm-semantic-router","name":"vLLM Semantic Router","tagline":"Apache-2.0 Mixture-of-Models router — pick or compose the model path per request","category":"agents","categoryName":"AI Agents","url":"https://vllm-sr.ai","github":"https://github.com/vllm-project/semantic-router","pricing":"open-source","hook":"vLLM Semantic Router sits between your OpenAI/Anthropic-compatible endpoint and your model fleet and decides, per request, which model path to run — direct, specialist, local, cascade, or collaborative — from signals like intent, difficulty, modality, identity, and risk.","whatsGood":"Apache-2.0 (vllm-project/semantic-router, v0.4.0; PyPI `vllm-sr` 0.4.0). Go core in the vLLM org. Stable entrypoints resolve to “recipes” that can attach retrieval, memory, tool filtering, caching, safety checks, and verification. Works with Envoy and existing inference runtimes rather than replacing them; Docker, Kubernetes, and hardware paths documented; public playground. ★~6k.","theCatch":"Platform, not a one-file proxy: it coordinates alongside Envoy and your model servers, so budget real ops time; the docs are written for heterogeneous fleets (cloud/data center/edge) more than a two-model hobby setup. Install is a `curl | bash` script (pip/uv paths exist — prefer those if you audit installs). Vs litellm / bifrost (multi-provider gateways) and weave-router (ELv2 embedder router): this is Apache policy-driven semantic routing that composes model paths.","verdict":"Apache MoM router when one endpoint must route across many models and hardware by intent and cost — overkill if LiteLLM fallbacks already cover you.","addedAt":"2026-10-05","featured":false,"domain":"AI Agents","subSpecialty":"Agents","subcategory":"Inference & Local Models","tags":["self-host","permissive","local-llm","active"],"capabilities":[],"surfaces":["Self-host"],"ecosystem":["Multi-platform"],"licenseModel":"Apache-2.0","githubStars":6213,"starsPerWeek":104,"access":"free","archived":false,"repo":{"createdAt":"2025-08-26","pushedAt":"2026-10-19","license":"Apache-2.0","archived":false,"checkedAt":"2026-10-19"}},"related":[{"slug":"claude-code","name":"Claude Code","tagline":"Terminal-first coding agent with deep repository context"},{"slug":"cursor","name":"Cursor","tagline":"The AI-first code editor that understands your codebase"},{"slug":"devin","name":"Devin","tagline":"Autonomous AI engineer for defined engineering tasks"},{"slug":"stagehand","name":"Stagehand","tagline":"AI-native browser automation that mixes code and natural language"},{"slug":"browser-use","name":"Browser Use","tagline":"Open-source framework for LLM-driven browser agents"}],"links":{"self":"/api/gems/vllm-semantic-router","html":"/gems/vllm-semantic-router","markdown":"/gems/vllm-semantic-router.md","category":"/api/gems?category=agents","categoryPage":"/stacks/agents"}}