llmops

A set of lessons aimed at anyone learning LLM and generative AI concepts, with sections on operations and security, as well as development.

qKnow is an open-source agent platform for enterprise knowledge intelligence and industry AI. It provides knowledge graphs, RAG, and bot building, encapsulating industry AI into standardized modules for rapid deployment. Supporting unified integration of documents and data, it helps enterprises quickly build knowledge hubs and AI solutions.

Visual node-edge graph GUI editor for LangGraph and run with local LLM or online API

Terraform configuration for deploying Dify on Google Cloud with scalability, high availability, and production-level readiness.

FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)

an MLOps/LLMOps platform

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history, tool output, and code before they're sent: -31% input / -74% output, measured live. Any provider, no extra model calls. Also an MCP server and embeddable library (Rust, Python, Ruby, Kotlin, Swift, JS/TS).

A curated list of battle-tested tools, frameworks, and best practices for building scalable, production-grade Retrieval-Augmented Generation (RAG) systems.

Open-source framework that gives you AI Agents that help you navigate decision-making, get personalized goals and execute them

[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications

🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps

This is a landscape of the infrastructure that powers the generative AI ecosystem

A curated list of open source repositories for AI Engineers

Graph-Orchestrated Agent Loop — a production-grade framework on LangGraph. Combine workflow graphs and agent loops, transpile Dify DSL to runnable code, swap wire protocols (Dify/OpenAI).

An End to End GenAI Framework

Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging componants like Lego pieces.

A diverse, simple, and secure all-in-one LLMOps platform

AI Engineering Specially Topics- Agentic AI & GenAI Explanation

Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage controls.