llm

Pebblo enables developers to safely load data and promote their Gen AI app to deployment

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

Your AI intranet: network the computers you already own for inference and training.

[ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark

[EMNLP 2024] OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs.

Never give AI companies your secrets! A local LLM-based privacy filter for LLM users. Seamless integration with your existing AI tools as a Python library / OpenAI SDK replacement / API Gatetway / Web Server.

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Fenix Ai Trading Bot with LangGraph and ollama and multipe providers

Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

Cognitive prisms for structural analysis — any domain, any model. 1000+ experiments, 58 prisms, 27 scan modes. The cheapest model + right prism beats the most expensive without one. Cross-architecture validated: Claude + Gemini converge on the same structural laws.

Stop agents from over-engineering. Inspired by Ponytail, but without the plugin madness. Just one AGENTS.md file.

🌟1000+ Expert AI Skills | CEO, Doctor, Engineer, Scientist & more | Transform AI into any professional | Powered by https://theneoai.github.io/skill-writer/

A curated list of tools, papers, and datasets for applying AI to cybersecurity tasks. This list primarily focuses on modern AI technologies like Large Language Models (LLMs), Agents, and Multi-Modal systems and their applications in security operations.

Harnessing the Memory Power of the Camelids

A private, modular node based AI workspace for thinking and creation. Seamlessly connect to Ollama, OpenAI, Gemini, Anthropic, and Groq models in one unified, node-based interface for reasoning, visualization, and exploration — all running locally or via API.

Universal LLM Interface

Implementing Skills functionality for your agents

flow + prompt = flompt - Visual AI Prompt Builder. Decompose, edit as flowchart, recompile into optimized machine-readable prompts

Browser extension and framework to use and build AI assistants for any web application

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.