llmops

Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.

LLM Prompt Injection Detector

The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across local, cloud, and edge environments.

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents

AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.

OpenTelemetry Instrumentation for AI Observability

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Evaluate your LLM's response with Prometheus and GPT4 💯

Dynamiq is an orchestration framework for agentic AI and LLM applications

📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops

Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

What if OpenAI Deep Research and Dify were one platform? OpenAgent — harness architecture for rapidly building vertical AI agents, with deep reasoning loops, visual workflows, RAG, and A2A delegation.

Fast, streaming indexing, query, and agentic LLM applications in Rust

利用LLM构建应用实践笔记

LLMFlows - Simple, Explicit and Transparent LLM Apps

End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects