multimodal-large-language-models

[NeurIPS 2025] Deep Memory Backtracking for Long Video Understanding

[ICLR 2025] Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality

A Unified Framework for Benchmarking Generative Electrocardiogram-Language Models (ELMs)

Moondream is a lightweight multimodal large language model

[ACL 2024] An Easy-to-use Hallucination Detection Framework for LLMs.

[NeurIPS 2025] The official repository of "Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning"

This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"

[MLHC 2025] ECG-Byte: A Tokenizer for End-to-End Generative Electrocardiogram Language Modeling

StreamUni is a framework that efficiently enables unified Large Speech-Language Models to accomplish streaming speech translation in a cohesive manner.

A question-conditioned, reasoning-aware image editor designed to serve as a decoupled visual reasoning assistant for Multimodal Large Language Models (MLLMs).

Multimodal AI Assistant is an advanced chatbot designed for local interactions with LLMs, files, and multimodal functionalities. Built on the Chainlit framework, it integrates Langchain and ChatOllama for hosting models locally, with cloud storage and monitoring via LiteralAI.

MultimodalHugs is an extension of Hugging Face that offers a generalized framework for training, evaluating, and using multimodal AI models with minimal code differences, ensuring seamless compatibility with Hugging Face pipelines.

A research-oriented training and evaluation framework for ECG-Language Models (ELMs)

ArtSeek: Deep artwork understanding via multimodal in-context reasoning and late interaction retrieval

This repo contains evaluation code for MM-IQ benchmark.