mixtral
21 个项目 · ⭐ 43.2k🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
On-device LLM Inference Powered by X-Bit Quantization
Bypass restricted and censored content on AI chat prompts 😈
The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"
A Ruby gem for interacting with Ollama's API that allows you to run open source AI LLMs (Large Language Models) locally.
AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models
Self-host a ChatGPT-style web interface for Ollama 🦙
Deploy a RESTful API Server to interact with Ollama and Stable Diffusion
Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama
共 21 条 · 第 1 / 2 页