AutoGPTQ/AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

⭐ 5.1k ⑂ 543 Python MIT · 2025-04-11推送

deep-learning inference large-language-models llms nlp pytorch quantization transformer transformers

5.1k

Watchers

0

贡献者

0

Commits

0

Releases

272

Open Issues

2025-04-11

最近推送

原文中文

暂无 README