vision-language-model

Local inference server for Apple Silicon — hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI API

Finalist at Brainhack TIL 2024: Team 12000SGDPLUSHIE

Official Implementation of "Visual Agentic Memory: Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval"

This repository provides the official resources for EMNLP 2025 Paper Grounding Multilingual Multimodal LLMs With Cultural Knowledge

Local AI for Apple Silicon. Chat with open LLMs (Qwen, Gemma, DeepSeek, Mistral, Llama…) fully offline on your Mac via Apple MLX — private by design, zero telemetry.

AI hardware fit calculator for LLM, embedding, reranker, OCR and VLM workloads — VRAM, throughput, licensing and multi-GPU planning

Agentic radiology report generator for CT abdomen-pelvis · two vision encoders + MLP head · 220 RATE findings · auditable, deterministic, research-only

This application utilizes the powerful Florence-2 vision-language model from Microsoft to generate comprehensive captions for images. The model is capable of understanding visual content and expressing it in natural language.

A full-modal personal knowledge base built on the Karpathy LLM Wiki concept.

[🔥 ICLR 2026] - Misaligned Roles, Misplaced Images: Structural Input Perturbations Expose Multimodal Alignment Blind Spots

AOI: a model-agnostic perception layer giving computer-use agents adaptive video + audio perception with zero retraining, plus DynaCU-Bench (100 dynamic browser tasks). Paper + benchmark + code.

Run NVIDIA's tri-modal Nemotron Omni (text+vision+audio) entirely on Apple Silicon — pure MLX runtime, parity-verified against NVIDIA's reference

[ICCV 2025] Know "No" Better: A Data-Driven Approach for Enhancing Negation Awareness in CLIP

Gradio-based web UI for medical image interpretation using Google's MedGemma vision-language model.

Read PGS (Bluray) and VobSub (DVD) image subtitles and extract their text using external Vision Language Models.

GDB: GraphicDesignBench - A real-world benchmark for evaluating AI on graphic design tasks

Official codebase for RetFiner: A Vision-Language Refinement Scheme for Retinal Foundation Models