pegainfer-project/pegainfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

⭐ 655 ⑂ 102 Rust Apache-2.0 · 1 天前推送

https://pegainfer.org/

cuda deepseek gpu inference inference-engine kimi kimi-k2 llm llm-inference llm-serving model-serving moe openai-api qwen qwen3 rust vllm kv-cache cuda-kernels paged-attention

655

Watchers

0

贡献者

0

Commits

0

Releases

109

Open Issues

1 天前

最近推送

原文中文

暂无 README