llm-framework

Minimal typescript agent framework that keeps it simple and gives you control - no BS

cruby's capable AI runtime

Imagine a world where everyone can access powerful AI models—LLMs, generative image models, and speech recognition—directly in their web browser. Integrating AI into daily browsing will revolutionise online interactions, offering instant, intelligent assistance tailored to individual needs.

An Execution Isolation Architecture for LLM-Based Agentic Systems

A handy lib for smooth interaction with large language models (LLMs) and crafting AI apps.

A Typescript library to use LLM providers APIs in a unified way.

Self-hosting Langfuse on Amazon ECS with Fargate using CDK Python

Deploy production-ready AI services in minutes. One YAML file for agents, RAG pipelines, and MCP servers — run anywhere. Inspired by docker-compose.

This project aims to introduce and demonstrate the practical applications of RAG using Python code in a Jupyter Notebook environment.

🚀 A powerful Flutter-based AI chat application that lets you run LLMs directly on your mobile device or connect to local model servers. Features offline model execution, Ollama/LLMStudio integration, and a beautiful modern UI. Privacy-focused, cross-platform, and fully open source.

Geniusrise: Framework for building geniuses

LLM security and privacy

npm like package ecosystem for Prompts 🤖

A high-performance RDMA distributed file system for fast LLM Inference and GPU Training.

Minimal, async-first Python framework for production LLM apps- 2 hard deps, no magic, no SaaS.