vision-language-model

Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

Archived snapshot of Thinking-with-Visual-Primitives

From scratch implementation of a vision language model in pure PyTorch

a comprehensive and critical synthesis of the emerging role of GenAI across the full autonomous driving stack

[NeurIPS-2023] Annual Conference on Neural Information Processing Systems

[ICML 2026] GRACE-VLM: deployable INT4 Qwen3-VL via quantization-aware distillation.

Florence-2 is a novel vision foundation model with a unified, prompt-based representation for a variety of computer vision and vision-language tasks.

Embed arbitrary modalities (images, audio, documents, etc) into large language models.

不想啃 5000+ 全文？我已经替你和 LLM 啃完了 — ICLR 2026 全景中文导读

Robotics research demonstrating reliability and robustness in the real world (continuously updated)

[NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

[TMLR 25] SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models

NEWTON: Agentic Planning for Physically Grounded Video Generation

LitePali is a minimal, efficient implementation of ColPali for image retrieval and indexing, optimized for cloud deployment.

German-OCR is specifically trained to extract text from German documents including invoices, receipts, forms, and other business documents.

[ICCV 2025] The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate".

[ICLR2025 Oral] ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understanding

Awesome Audio-Visual Intelligence, Survey of Audio-Visual Intelligence

​This repository provides code and resources for automating manufacturing feature recognition in CAD designs using vision-language models.

Real-time football video analytics: player/ball/referee tracking and pitch keypoints. YOLO, HRNet, OSNet, ByteTrack, FastAPI. Game state recognition with lightweight CLIP/VLM validation. Python, OpenCV, CUDA/MPS.