multimodal

A multimodal chat interface with many tools.

[ICLR 2026] DecAlign: Hierarchical Cross-Modal Alignment for Decoupled Multimodal Representation Learning

[AAAI 2025] Official repo for paper "MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal Controls"

Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics, Fundamental Sciences such as Mathematics, and Ominous.

An out-of-the-box local Web UI for DeepSeek-OCR. Built with FastAPI + Vue.js, it supports PDF/Image uploads, progress tracking, and result visualization with bounding boxes. Easily experience the power of a top-tier OCR model.

🔆 📝 A reading list focused on Multimodal Emotion Recognition (MER) 👂👄 👀 💬

MixGen: A New Multi-Modal Data Augmentation

Image Acceptable Alpaca (Image-Text Chat AI).

Matryoshka Multimodal Models

[ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale

[NAACL 2022 Findings] Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction

Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)

Ethicore Engine™ is an AI safety, ethics, and compliance platform. This repo consists of the open-source components of Ethicore Engine™ - Guardian SDK; designed to protect your AI applications from prompt injection, jailbreaks, role hijacking, system-prompt extraction, and 100+ additional threat categories through a multi-layer analysis pipeline

Multimodal prototyping for cancer survival prediction - ICML 2024

micapipe from the Multimodal imaging and connectome analysis lab (http://mica-mni.github.io) at the Montreal Neurological Institute. Read The Docs documentation below

Collection of resources for finetuning Large Language Models (LLMs).

Pluggable metadata management framework for versioned incremental multimodal data/ML pipelines.

MinkLoc++: Lidar and Monocular Image Fusion for Place Recognition

VT.ai - multimodal AI chat app with dynamic conversation routing

Open-source Android AI using LiteRT-LM with hardware acceleration, cloud providers, memory, and voice.