cactus-compute/cactus

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

⭐ 5.9k ⑂ 492 C++ NOASSERTION · 2 天前推送

https://cactuscompute.com

ai android arm edge edge-ai framework ios llamacpp llm llm-inference llms mobile mobile-inference on-device-ai quantiz rag smartphone speech transformer whisper

5.9k

Watchers

0

贡献者

0

Commits

0

Releases

94

Open Issues

2 天前

最近推送

原文中文

暂无 README