NVIDIA/Model-Optimizer
摘要
NVIDIA 开源了 Model Optimizer（ModelOpt），把量化、剪枝、NAS、蒸馏、投机解码、稀疏化等技术收进一个库，输入支持 Hugging Face、PyTorch 和 ONNX，采用 Apache 2.0 许可，PyPI 包名为 nvidia-modelopt。适合需要在部署前压缩深度学习模型的开发者。
相关推荐
lyogavin/airllm
AirLLM 2.8T LLM inference with single 4GB GPU
microsoft/BitNet
Official inference framework for 1-bit LLMs
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
alibaba/open-code-review
Secure, fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.