rwkv
11 个项目 · ⭐ 38.4kRWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
仅需Python基础,从0构建大语言模型;从0逐步构建GLM4\Llama3\RWKV6, 深入理解大模型原理
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.
PDF解析(文字,章节,表格,图片,参考),基于大模型(ChatGLM2-6B, RWKV)+langchain+streamlit的PDF问答,摘要,信息抽取
顺便一提,我们支持 RWKV | 「Intel 2025 人工智能创新大赛」🚀AutoOPS: Provide the chaos brought by language models to the operation and maintenance industry! 🏆使用 LLM 提供的动力实现全自动运维,支持 Windows Server/Linux/macOS/Cisco IOS,可进行全网自动管理,让我们颠覆运维行业【带外管理/自动运维/IoT设备管理/WebHook监控/任意平台/全模态Workflow】
SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models