multimodal

Gemini Vision & Image Generation MCP for Claude Desktop and Claude Code

[CVPR 2026] This is the official PyTorch implementation of "MoDES: Accelerating Mixture-of-Experts Multimodal Large Language Models via Dynamic Expert Skipping".

[ICLR 2025] Official code repository for "TULIP: Token-length Upgraded CLIP"

🦀 Rust powered LLM, Whisper, Embedding inference, backed by 🤗 candle from HuggingFace

Learn how multimodal AI merges text, image, and audio for smarter models

Framework for processing and filtering datasets

Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)

A unified Model Context Protocol server for MiniMax CLI (mmx)

Repository contains LinkedIn posts about Generative AI knowledge sharing, learning resources and research explanations.

A curated list of awesome Google Gemini Omni prompt guides, interactive platforms, and creative showcases.

Free unlimited Gemini API for any OpenAI-compatible app.

OpenCode vision support: automatically saves pasted images and guides non-vision models to recognize them via tool calling. Supports single & multiple images.

🗄 A Rust library designed as a specialized database for AI Agents, focusing on knowledge memory.

A prototype user experience concept for building interactive worlds and telling stories at the same time by sketching and speaking; Ph.D. Thesis Project and ACM UIST Publication: "DrawTalking: Building Interactive Worlds by Sketching and Speaking"; Paper: https://dl.acm.org/doi/10.1145/3654777.3676334

A comprehensive hands-on guide to building production-grade distributed applications with Ray - from distributed training and multimodal data processing to inference and reinforcement learning.

Official Repository for the paper Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach published in ECCV 2020 (https://arxiv.org/abs/2007.12553)

Un framework in Italiano ed Inglese, che permette di chattare con i propri documenti in RAG, anche multimediali (audio, video, immagini e OCR). It is an Italian and English framework, which allows you to chat with your documents in RAG, including multimedia (audio, video, images and OCR).

A beautiful Gemini-powered chat interface with multimodal support

BackdoorMBTI is an open source project expanding the unimodal backdoor learning to a multimodal context. We hope that BackdoorMBTI can facilitate the analysis and development of backdoor defense methods within a multimodal context.

[ECCV 2026 Oral] Official Pytorch implementation for See & Sniff: Learning Visuo-Olfactory Representations