{"data":{"slug":"model-optimizer","name":"NVIDIA Model Optimizer","tagline":"Apache-2.0 quantization/pruning/NAS/distill for HF → TensorRT-LLM/vLLM","category":"python","categoryName":"Python","url":"https://nvidia.github.io/Model-Optimizer/","github":"https://github.com/NVIDIA/Model-Optimizer","pricing":"open-source","hook":"NVIDIA Model Optimizer (ModelOpt) is the Apache-2.0 Python library for quantization, pruning, NAS, distillation, and speculative decoding on HF/PyTorch/ONNX models toward TensorRT-LLM, vLLM, or SGLang.","whatsGood":"Apache-2.0 (NVIDIA/Model-Optimizer). Free via PyPI `nvidia-modelopt`. Composable optimize → export path for Hugging Face / PyTorch / ONNX into SGLang, TensorRT-LLM, TensorRT, or vLLM. Active NVFP4/QAD tutorials and Nemotron checkpoint recipes. ★4527 on GitHub.","theCatch":"NVIDIA stack gravity (TensorRT, Megatron, CUDA) — not an agent product. Serious runs need GPU/CUDA reality; CPU toy paths will not match the blog numbers. Ecosystem pull toward NVIDIA deploy targets even though the license is open.","verdict":"Apache-2.0 model-optimization library when you compress HF/PyTorch models for TensorRT-LLM/vLLM/SGLang — skip if you wanted an agent framework.","addedAt":"2026-09-26","featured":false,"domain":"Python","subSpecialty":"Python","subcategory":"Python","tags":["self-host","permissive","local-llm","active"],"capabilities":[],"surfaces":["Self-host"],"ecosystem":["Python"],"licenseModel":"Apache-2.0","githubStars":5362,"starsPerWeek":41,"access":"free","archived":false,"repo":{"createdAt":"2024-04-23","pushedAt":"2026-10-19","license":"Apache-2.0","archived":false,"checkedAt":"2026-10-19"}},"related":[{"slug":"fastapi","name":"FastAPI","tagline":"Modern Python APIs at startup speed"},{"slug":"pydantic","name":"Pydantic","tagline":"Data validation using Python type hints"},{"slug":"uv","name":"uv","tagline":"Python packaging at Rust speed"},{"slug":"ruff","name":"Ruff","tagline":"Python linter faster than your test suite"},{"slug":"polars","name":"Polars","tagline":"DataFrames that respect your CPU"}],"links":{"self":"/api/gems/model-optimizer","html":"/gems/model-optimizer","markdown":"/gems/model-optimizer.md","category":"/api/gems?category=python","categoryPage":"/stacks/python"}}