ml

Framework to bring LLM applications to production

⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

Official Implementation for the ACL 2026 paper "SARA: Selective and Adaptive Retrieval-augmented Generation with Context Compression"

Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced features like document analysis, vector search, and multi-model AI support - all while keeping your data private.

Curiso is an infinite canvas for your thoughts

Browser-compatible JS library for running language models

⚡ GUI for editing LLM vector embeddings. No more blind chunking. Upload content in any file extension, join and split chunks, edit metadata and embedding tokens + remove stop-words and punctuation with one click, add images, and download in .veml to share it with your team.

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"

Simplify and improve the job hunting experience by integrating LLMs to automate tasks such as resume and cover letter generation, as well as application submission, saving users time and effort.

NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.

Immersive workshop showcasing the remarkable potential of integrating SoTA foundation models to enhance product experiences and streamline backend workflows. Leverages Microsoft's Copilot stack, Microsoft Agent Framework and Azure primitives to offer an engaging and comprehensive introduction to AI-infused app development and deployment

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

Full stack voice chatbot

Repo for Morgan Stanley Machine Learning Research group's publications

Interpret text data with LLMs (sklearn compatible).

Beginner's Guide to reComputer Jetson

A curated collection of AI learning materials

🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps