ai-monitoring

AI Observability & Evaluation

Evaluation and Tracking for LLM Experiments and AI Agents

本地监控 + AI 视觉 — LAN-based smartphone-powered AI monitoring framework with structured event output for data acquisition and analysis.

React components for visualizing traces from AI agents

Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.

Production-ready Retrieval Augmented Generation (RAG) system with hybrid retrieval, advanced evaluation metrics, and monitoring. Build enterprise LLM applications with reduced hallucinations, better context management, and comprehensive observability.