vision-and-language

A one stop repository for generative AI research updates, interview resources, notebooks and much more!

LAVIS - A One-stop Library for Language-Vision Intelligence

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

[EMNLP-2024] Build multimodal language agents for fast prototype and production

Multimodal-GPT

日本語LLMまとめ - Overview of Japanese LLMs

Codebase for Aria - an Open Multimodal Native MoE

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

[ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point Clouds

About This repository is a curated collection of the most exciting and influential CVPR 2025 papers. 🔥 [Paper + Code + Demo]

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

This repository is a curated collection of the most exciting and influential CVPR 2024 papers. 🔥 [Paper + Code + Demo]

This repository is a curated collection of the most exciting and influential CVPR 2023 papers. 🔥 [Paper + Code]

Creating a software for automatic monitoring in online proctoring

This repo lists relevant papers summarized in our survey paper: A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models.

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)

This AI Smart Speaker uses speech recognition, TTS (text-to-speech), and STT (speech-to-text) to enable voice and vision-driven conversations, with additional web search capabilities via OpenAI and Langchain agents.

HPT - Open Multimodal LLMs from HyperGAI

[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"