onnxruntime

Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.

Open source real-time translation app for Android that runs locally

X-AnyLabeling: A lightweight, efficient, and unified cross-platform desktop application for annotating text, image, video, and multimodal data, combining versatile built-in tools with state-of-the-art AI models and flexible multi-format export.

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

An Engine-Agnostic Deep Learning Framework in Java

A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

QualityScaler - image/video AI upscaler app

OpenMMLab Model Deployment Framework

Fast ML inference & training for ONNX models in Rust

Voice activity detector (VAD) for the browser with a simple API

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

AI Productivity Tool - Free and open source, improve user productivity, and protect privacy and data security. Including but not limited to: built-in local exclusive ChatGPT, DeepSeek, Phi, Qwen and other models, one-click batch intelligent processing of pictures, videos, audio, etc.

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6

A simple Windows / Xbox app for generating AI images with Stable Diffusion.

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

Inference Stable Diffusion with C# and ONNX Runtime