multimodal

VideoEval-Pro: Robust and Realistic Long Video Understanding Evaluation [TMLR26]

A curated list of resources for Grok, the AI developed by xAI

[NAACL 2025 Findings] Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding

[ICLR 2026] Official repository of "Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMs".

Recurrence Meets Transformers for Universal Multimodal Retrieval

Official Implementation of "Visual Agentic Memory: Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval"

This is a multi-modal fusion method based on VGG16 and FastText for identifying useful information collected from social media platforms.

Package for bimodal training of deep neural networks on neurological data. Pypi: https://pypi.org/project/BiModNeuroCNN/

Pytorch Implementation of CLIP-Lite | Accepted at AISTATS 2023

PegasusX: The Future of Multimodal Embeddings 🦄 🦄

A modular, multilingual, and multimodal Retrieval-Augmented Generation (RAG) system tailored for the financial analysis of Public Investment Fund (PIF) annual reports.

Cognitive-structured Multimodal Agent (CMA-Harness): a memory-centric agent for long-horizon multimodal understanding, generation, and editing — externalizing visual history into episodic memory with selective retrieval. Includes the M2CA-Bench benchmark.

OpenRouter skill for AI agents: model discovery, multimodal chat, tool calling, routing, and starter templates.

It is the implementation of paper "Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model"

[NLPCC 2024] Shared Task 10: Regulating Large Language Models

Torch code for Visual Question Generation

Code for the paper [SIGIR'26]“Towards Mixed-Modal Retrieval for Universal Retrieval-Augmented Generation”

Introducing Muse Glimmer: open-weight 30B agentic multimodal model that runs on your device (Meta). Interactive local agent lab + guide. Apache 2.0 · on-device AI · function calling

Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes

对标蚂蚁阿福的开源大健康 AI 助手，基于 LangGraph + FastAPI + React，支持多智能体、RAG、报告解读、拍照问药与链路评估。Open-source AI health assistant inspired by Ant Afu, with multi-agent routing, RAG, multimodal medical vision, tracing, and evals.