{"data":{"slug":"smg","name":"SMG (Shepherd Model Gateway)","tagline":"Apache-2.0 Rust gateway that routes OpenAI and Anthropic API traffic across vLLM, SGLang, TRT-LLM and cloud models","category":"agents","categoryName":"AI Agents","url":"https://lightseek.org/smg","github":"https://github.com/smg-project/smg","pricing":"open-source","hook":"SMG is a model-routing gateway written in Rust: one OpenAI- and Anthropic-compatible endpoint in front of self-hosted engines and cloud providers.","whatsGood":"Apache-2.0 (smg-project/smg), release v1.13.0 (2026-10-15), commit on 2026-10-21. ★~660 (~14 a week). It manages worker lifecycles, routes with KV-cache awareness, and adds chat-history storage, MCP tooling, multi-tenant auth and observability. Ships via Docker and PyPI. Useful when you run several inference engines or GPUs and want one endpoint that balances across them.","theCatch":"It is the layer in front of an engine, not an engine. The SGLang gem serves the model; SMG routes traffic to SGLang, vLLM, TRT-LLM or cloud APIs. If you run one model on one box, you don't need it. The project is young (repo started November 2025) and small, so expect gaps against heavier gateways.","verdict":"A serious open gateway for multi-engine LLM fleets; overkill for a single server.","addedAt":"2026-10-21","featured":false,"domain":"AI Agents","subSpecialty":"Agents","subcategory":"Inference & Local Models","tags":["api","self-host","permissive","local-llm","active"],"capabilities":["api"],"surfaces":["API","Self-host"],"ecosystem":["Multi-platform"],"licenseModel":"Apache-2.0","githubStars":656,"starsPerWeek":14,"access":"free","archived":false,"repo":{"createdAt":"2025-11-22","pushedAt":"2026-10-21","license":"Apache-2.0","archived":false,"checkedAt":"2026-10-21"}},"related":[{"slug":"claude-code","name":"Claude Code","tagline":"Terminal-first coding agent with deep repository context"},{"slug":"cursor","name":"Cursor","tagline":"The AI-first code editor that understands your codebase"},{"slug":"devin","name":"Devin","tagline":"Autonomous AI engineer for defined engineering tasks"},{"slug":"stagehand","name":"Stagehand","tagline":"AI-native browser automation that mixes code and natural language"},{"slug":"browser-use","name":"Browser Use","tagline":"Open-source framework for LLM-driven browser agents"}],"links":{"self":"/api/gems/smg","html":"/gems/smg","markdown":"/gems/smg.md","category":"/api/gems?category=agents","categoryPage":"/stacks/agents"}}