multimodal

Baselines for CCKS 2022 Task "Link Prediction for Multimodal Product Knowledge Graph"

Repository for awesome spatial/visual reasoning MLLMs. (focus more on embodied applications)

React component library for crafting user-friendly and engaging conversational experiences

Tensorflow implementation of "Deep Multimodal Subspace Clustering Networks"

[ICLR 2025] - Cross the Gap: Exposing the Intra-modal Misalignment in CLIP via Modality Inversion

[CVPR 2024] Unified Multi-Sensor Tracker With One Parameter Set

[NeurIPS 2025] Deep Memory Backtracking for Long Video Understanding

Not just slides - delivery-ready talks

Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"

[IJCAI 2024] Continual Multimodal Knowledge Graph Construction

EmbodiedAgents is a fully-loaded ROS2 based framework for creating interactive physical agents that can understand, remember, and act upon contextual information from their environment.

IROS/ISVC 2023: Multimodal Dataset for Localization, Mapping and Crop Monitoring in Citrus Tree Farms

the world's first large-scale multi-modal short-video encyclopedia, where the primitive units are items, aspects, and short videos.

Multimodal Graph Learning: how to encode multiple multimodal neighbors with their relations into LLMs

OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewer frames on LVBench.

[ICLR 2025] Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality

Modality-Transferable-MER, multimodal emotion recognition model with zero-shot and few-shot abilities.

<만들면서 배우는 생성 AI 2판>의 코드 저장소

[CVPR 2021] SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Events

A sample app for the Multimodal Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power Q&A experiences.