multimodal

[ICLR 2026] VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning

Convert files (PDF, image, Word, PPT, Excel, notebooks, code snippets) to markdown using powerful multimodal LLM

A curated list of awesome Multimodal studies.

Implementation of "PaLM-E: An Embodied Multimodal Language Model"

(NeurIPS D&B 2024) STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases

Fusing Histology and Genomics via Deep Learning - IEEE TMI

[TMM'26] Continuously Updated Awesome Multimodal Recommendation Paper List

Easily convert common crawl to a dataset of caption and document. Image/text Audio/text Video/text, ...

《多模态大模型：新一代人工智能技术范式》配套教学资源

HPT - Open Multimodal LLMs from HyperGAI

[WACV 2024 Survey Paper] Multimodal Large Language Models for Autonomous Driving

[CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks

Pixel-Level Reasoning Model trained with RL [NeuIPS25]

Video understanding and self-verification for AI agents. Turn videos, streams, and agent screen recordings into searchable, timestamped evidence—then use THE LOOP to inspect, fix, and verify the work. MCP, CLI, REST, local-first.

Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond

Multi-Agent System Powered by LLMs for End-to-end Multimodal ML Automation

AUITestAgent is the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification.

Seamlessly integrate state-of-the-art transformer models into robotics stacks

[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning