{"data":{"slug":"uzu","name":"uzu","tagline":"MIT on-device inference engine for Apple Silicon apps","category":"agents","categoryName":"AI Agents","url":"https://trymirai.com","github":"https://github.com/trymirai/uzu","pricing":"open-source","hook":"uzu is a Rust inference engine for running models inside your own app on Apple devices, with Swift, Python and TypeScript bindings, tool calls, structured output and an OpenAI-compatible server mode.","whatsGood":"MIT (trymirai/uzu), release 0.6.3. Native Rust crate; Swift bindings via uniffi, Python via pyo3, TypeScript via napi-rs. Metal and CPU backends, using unified memory on Apple devices; targets macOS, iOS and Mac Catalyst. One high-level API covers local chat sessions, structured output, tool calls, and optional cloud models through your own OpenAI key. A CLI can browse, download, benchmark and serve models over /v1/chat/completions. ★~2.2k.","theCatch":"Apple-first: Linux, Windows and WASM targets are still listed as in progress. It uses its own model format — you download Mirai's converted models or export one yourself with their lalamo tool, so you cannot drop in an arbitrary GGUF. The Rust quick start pulls from the git main branch. Backed by a company (Mirai). Vs Rapid-MLX (a local server for coding agents on a Mac): uzu is an embeddable engine for shipping AI inside iOS and macOS apps.","verdict":"The pick for on-device models inside an iOS or macOS app — MIT and free, but Apple-only for now and tied to its own model format.","addedAt":"2026-10-13","featured":false,"domain":"AI Agents","subSpecialty":"Local Inference","subcategory":"Inference & Local Models","tags":["sdk","self-host","local-first","permissive","local-llm","active"],"capabilities":["inference","local","sdk"],"surfaces":["SDK","Self-host"],"ecosystem":["Rust","Python","Node.js"],"licenseModel":"OSS/MIT","githubStars":2398,"starsPerWeek":35,"access":"free","archived":false,"repo":{"createdAt":"2025-06-23","pushedAt":"2026-10-18","license":"MIT","archived":false,"checkedAt":"2026-10-19"}},"related":[{"slug":"claude-code","name":"Claude Code","tagline":"Terminal-first coding agent with deep repository context"},{"slug":"cursor","name":"Cursor","tagline":"The AI-first code editor that understands your codebase"},{"slug":"devin","name":"Devin","tagline":"Autonomous AI engineer for defined engineering tasks"},{"slug":"stagehand","name":"Stagehand","tagline":"AI-native browser automation that mixes code and natural language"},{"slug":"browser-use","name":"Browser Use","tagline":"Open-source framework for LLM-driven browser agents"}],"links":{"self":"/api/gems/uzu","html":"/gems/uzu","markdown":"/gems/uzu.md","category":"/api/gems?category=agents","categoryPage":"/stacks/agents"}}