llms

The TypeScript framework for agents & workflows with react-like components. Lightning fast dev loop. Easy to learn. Easy to extend.

A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.

A centralized manager for Model Context Protocol (MCP) servers with dynamic server management and monitoring

Prompt Decorators are structured prefixes, such as +++Reasoning and +++StepByStep, designed to enhance AI responses. Inspired by Python decorators, they make AI outputs more logical, accurate, and well-organized without requiring lengthy instructions, simplifying interactions for users.

Super lightweight Ollama + Qwen Code alternative to run Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.

Explore the unknown, build the future, own your data.

ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-loop agents that run without supervision, and make asynchronous tool calls like requesting human feedback on key operations. Full MCP support.

[EMNLP 2025] Awesome RAG Reasoning Resources

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

Low-Code Full-Stack Agentic AI Development using LLMs, n8n, Loveable, UXPilot, Supabase and MCP. Class Videos: https://www.youtube.com/playlist?list=PL0vKVrkG4hWq5T6yqCtUL7ol9rDuEyzBH

Guideline following Large Language Model for Information Extraction

Practical system design, tools, and hands-on resources for building Gen-AI agents & agentic AI systems.

Govern & Secure your AI

MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.

[CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"

Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.

A web-based tool for visualizing and exploring artifacts from Microsoft's GraphRAG.

Fully neural approach for text chunking

This is the official repository for the book Transformers - The Definitive Guide

The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction