Picovoice/picollm

On-device LLM Inference Powered by X-Bit Quantization

⭐ 317 ⑂ 26 Python Apache-2.0 · 11 天前推送

https://picovoice.ai/

compression efficient-inference gemma generative-ai language-model language-models large-language-model llama llama2 llama3 llm llm-inference llms mistral model-compression natural-language-processing quantization self-hosted mixtral

317

Watchers

0

贡献者

0

Commits

0

Releases

0

Open Issues

11 天前

最近推送

原文中文

暂无 README