llamacpp

比简单更简单，通过 Ollama 不需要显卡轻松在你的电脑上运行 LLM。

Eternal is an experimental platform for machine learning models and workflows.

Python bindings for llama.cpp

LLM-Inference-Bench

GPTStonks is a financial chatbot powered by LLMs and enhanced with data frameworks. It provides natural language conversation capabilities for financial topics, making it an ideal choice for a wide range of financial applications.

🤖 Sam-assistant is a personal assistant that is designed to understand your documents, search the internet, and in future versions, create and understand images, and communicate with you. It is built in Python, mainly using Langchain and implements most of Langchain

CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion

🏆Winning Project | ModelGate is a contract-aware AI control plane that ingests customer contracts, extracts SLA/privacy/routing constraints, and generates an OpenAI-compatible endpoint that automatically routes every request to the optimal model. Simple queries go to cheap models. Complex queries go to premium ones.

Train Llama 3 models from scratch. Any scale, any personality. By Arianna Method.

Perplexity style AI answer engine for AI PCs with CPU,GPU and NPU support

Empower your LLM to do more than you ever thought possible with these state-of-the-art prompt templates.

Streamlit + Langchain + LlamaCPP + Mistral + Rag

telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large language models, such as llama3

Hit your limit? Need privacy? Just swap the model, everything else stays

Enrich coding agent prompts with codebase context using a local LLM

Self-hosted meeting transcription portal — speech-to-text, speaker diarization, LLM-corrected transcripts, structured summaries and Word minutes, on your own GPUs. Flask + PostgreSQL, GDPR audit trail, distributed GPU topologies, docker

PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.

A web-based memory usage and performance calculator for Huggingface GGUF models

A set of jupyter notebooks

Perform RAG (Retrieval-Augmented Generation) from your PDFs using this Colab notebook! Powered by Llama 2