vlm

We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their performance.

The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]

[ICLR 2026🔥] SHIELD: Suppressing Hallucinations In LVLM Encoders via Bias and Vulnerability Defense

Convert pdf and image files into markdown

A comprehensive survey of Vision–Language Models: Pretrained models, fine-tuning, prompt engineering, adapters, and benchmark datasets

Official Implementation of "Visual Agentic Memory: Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval"

OMGM: Orchestrate Multiple Granularities and Modalities for Efficient Multimodal Retrieval (ACL 2025 Main Conference)

DeepSeek Harness 插件：DeepSeek Pro 大脑 + 自动识图。GUI 附加图片默认经官方 deepseek-v4-flash-vision-exp 原生识图，转译成文字后交给 DeepSeek 作答（纯文本的 V4-Pro 也能看图）；支持百炼/智谱/OpenRouter 等任意 OpenAI 兼容 VLM，无 key 自动探测本地 Ollama；安装时有一问式确认

AI hardware fit calculator for LLM, embedding, reranker, OCR and VLM workloads — VRAM, throughput, licensing and multi-GPU planning

EgoNormia | Benchmarking Physical Social Norm Understanding in VLMs

基于Qwen2.5-VL-3B + QLoRA的智能驾驶场景结构化理解系统

A full-modal personal knowledge base built on the Karpathy LLM Wiki concept.

The official implement of Unified Reasoning Emotion Generalist OneEmo

[WACV 2026 🔥] GAEA is a multimodal model with a new dataset and benchmark for context-aware image geolocation and QA.

GDB: GraphicDesignBench - A real-world benchmark for evaluating AI on graphic design tasks

Read PGS (Bluray) and VobSub (DVD) image subtitles and extract their text using external Vision Language Models.

Automated comic cataloging tool that identifies issues directly from cover images using a vision-language model, then cross-references results with the Grand Comics Database and the ComicVine API to generate structured, high-confidence collection data with minimal manual entry.