mllm

[CVPR 2026 Highlight] ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering

For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and Lin Tan

Awesome-HCI （Ubiquitous, LLM, MLLM, Agent, RAG, Embodied-AI, RLHF)

DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agents

Official Repository for NeurIPS'25 Paper "Tool-Augmented Spatiotemporal Reasoning for Streamlining Video Question Answering Task"

We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their performance.

[ICML'26] Toward Human-like Audio-Visual Intelligence of Omni-MLLMs

[WACV 2026] Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuning

[WACV 2025] I Dream My Painting: Connecting MLLMs and Diffusion Models via Prompt Generation for Text-Guided Multi-Mask Inpainting

The official implementation of NeurlPS 2025 D&B paper: IndustryEQA: Pushing the frontiers of Embodied Question Answering in Industrial Scenarios.

Official Implementation of "Visual Agentic Memory: Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval"

OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval (ACL 2025 Main Conference)

An Interactive Game-based Vision Planning benchmark

The official implementation of CVPR Workshop 2025 paper: Window Token Concatenation for Efficient Visual Large Language Models.

ArtSeek: Deep artwork understanding via multimodal in-context reasoning and late interaction retrieval