multimodal

autoupdate paper list

Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

😎 curated list of awesome LMM hallucinations papers, methods & resources.

[COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs

A curated list of awesome resources for salient object detection (SOD), focusing more on multi-modal SOD, such as RGB-D SOD.

[TMLR 25] SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models

🤩 An AWESOME Curated List of Papers, Workshops, Datasets, and Challenges from CVPR 2024

Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"

GEMS: Agent-Native Multimodal Generation with Memory and Skills

(NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Real-Time Self-Aware Emotional Speech Synthesis

State-of-the-art CLIP/SigLIP embedding models finetuned for the fashion domain. +57% increase in evaluation metrics vs FashionCLIP 2.0.

[ICLR 2025] Dissecting adversarial robustness of multimodal language model agents

(CVPR 2024) 🧩 TokenCompose: Text-to-Image Diffusion with Token-level Supervision

[ICLR 2023] Multimodal Analogical Reasoning over Knowledge Graphs

Learning Hierarchical and Geometry-Aware Graph Representations for Text-to-CAD

[ICLR 2025] ChartMimic: Evaluating LMM’s Cross-Modal Reasoning Capability via Chart-to-Code Generation

An advanced AI assistant that leverages the capabilities of ChatGPT API, Gemini Pro, AutoGen, and open-source LLMs, enabling it both to engage in conversations and to execute computing tasks on local devices.

InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions

NEWTON: Agentic Planning for Physically Grounded Video Generation