multimodal

[ECCV 2024] InstructIR: High-Quality Image Restoration Following Human Instructions https://huggingface.co/spaces/marcosv/InstructIR

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.

[CVPR 2019]: Pluralistic Image Completion

A Toolbox for MultiModal Recommendation. Integrating 10+ Models...

This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

✨✨Latest Papers and Benchmarks in Reasoning with Foundation Models

Official implementation of SEED-LLaMA (ICLR 2024).

Project Page For "Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement"

👁️ + 💬 + 🎧 = 🤖 Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]

Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]

Explore the Multimodal “Aha Moment” on 2B Model

This repository provides programs to build Retrieval Augmented Generation (RAG) code for Generative AI with LlamaIndex, Deep Lake, and Pinecone leveraging the power of OpenAI and Hugging Face models for generation and evaluation.

Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks

Second Brain is an agentic framework that acts as an operating system, using local file intelligence, workflow automation, and LLMs to complete tasks and communicate over multiple modalities and messaging platforms.

Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assets

[ECCV 2024] Tokenize Anything via Prompting

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

Official implementation for "Blended Diffusion for Text-driven Editing of Natural Images" [CVPR 2022]

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

Create browser automation as if you were teaching a human using GPT-4 Vision.