Stack Gems
Menu
← Catalog

llmfit

MIT CLI — which models fit your hardware

AI Agents / Tooling · OSS/MIT · 38.1k

Reviewed 2026-09-15 · last push 2026-10-19 · repo checked 2026-10-19

What's Good

MIT (AlexsJones/llmfit). Rust/`cargo`/crates.io CLI. Catalog-aware hardware fit finder — VRAM, RAM, and provider options in one command instead of spreadsheet archaeology. Aimed at local/self-host planners before you pull a 70B that will not load.

The Catch

Vs Ollama / llama.cpp / vLLM (runtimes): llmfit is the hardware fit finder, not the model runtime. Catalogs and VRAM heuristics drift; always verify against your real device and quantization. Does not download or serve models for you.

Verdict

MIT hardware-fit CLI. Pick models that fit; run them elsewhere.

Embed

Maintainer? Add the badge to your README. It is free, links to this review, and there is no paid version.

Reviewed on Stack Gems

Markdown

[![Reviewed on Stack Gems](https://stackgems.com/badge/llmfit.svg)](https://stackgems.com/gems/llmfit)

HTML

<a href="https://stackgems.com/gems/llmfit"><img src="https://stackgems.com/badge/llmfit.svg" alt="llmfit reviewed on Stack Gems" height="20"></a>