serverless

🦖 Serverless AI Agent Framework with Geo-distributed Edge AI Infra.

Ultrafast serverless GPU inference, sandboxes, and background jobs

✨ AI-powered markdown editor - leverage LLMs with your documents - 100% local or in the cloud

Examples of programs built using Modal

A voice chat app

Kotlin Serverless Framework

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Intelligent enterprise-grade reference architecture for JavaScript, featuring OpenAI integration, Azure Developer CLI template and Playwright tests.

Build your own serverless AI Chat with Retrieval-Augmented-Generation using LangChain.js, TypeScript and Azure

A production-ready runtime framework for agent apps with secure tool sandboxing, Agent-as-a-Service APIs, scalable deployment, full-stack observability, and broad framework compatibility.

A modern, secure VPN application built with Flutter that provides internet freedom and privacy protection.

ComfyUI as a serverless API on Runpod

Multi-protocol cloud file upload and management with serverless / 无服务端的多协议云盘文件上传和管理APP

Self-host n8n on Google Cloud without the subscription fees or server headaches - because your automation workflows shouldn't cost more than your coffee budget

FaaS (Function as a service) framework for writing portable Dart functions

ClawLess — A serverless browser-based runtime for Claw AI Agents powered by WebContainers

Swift demonstration of how to build a Slack app that enables end-users to interact with a ChatGPT bot

Info about many of my Terraform, AWS, DevOps, and AI (tada!) projects.

Modern AI image generator with multi-provider support (Gitee AI, HuggingFace, ModelScope), OpenAI-compatible API, token rotation, and one-click deployment to Cloudflare Pages.