NVIDIA Model Optimizer

Apache-2.0 quantization/pruning/NAS/distill for HF → TensorRT-LLM/vLLM

Python / Python · Apache-2.0 · 5.4k

Reviewed 2026-09-26 · last push 2026-10-19 · repo checked 2026-10-19

What's Good

Apache-2.0 (NVIDIA/Model-Optimizer). Free via PyPI `nvidia-modelopt`. Composable optimize → export path for Hugging Face / PyTorch / ONNX into SGLang, TensorRT-LLM, TensorRT, or vLLM. Active NVFP4/QAD tutorials and Nemotron checkpoint recipes. ★4527 on GitHub.

The Catch

NVIDIA stack gravity (TensorRT, Megatron, CUDA) — not an agent product. Serious runs need GPU/CUDA reality; CPU toy paths will not match the blog numbers. Ecosystem pull toward NVIDIA deploy targets even though the license is open.

Verdict

Apache-2.0 model-optimization library when you compress HF/PyTorch models for TensorRT-LLM/vLLM/SGLang — skip if you wanted an agent framework.

Embed

Maintainer? Add the badge to your README. It is free, links to this review, and there is no paid version.

Markdown

[![Reviewed on Stack Gems](https://stackgems.com/badge/model-optimizer.svg)](https://stackgems.com/gems/model-optimizer)

HTML

<a href="https://stackgems.com/gems/model-optimizer"><img src="https://stackgems.com/badge/model-optimizer.svg" alt="NVIDIA Model Optimizer reviewed on Stack Gems" height="20"></a>

Python →

Related