multimodal

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

Generate editable scientific SVG figures from method text with local SAM3 and dual-provider routing.

Official Implementation for Pre-CoFact (AAAI-22 DeFactify Workshop Best Paper)

[ECCV 2022] Multimodal Transformer with Variable-length Memory for Vision-and-Language Navigation

ComfyUI custom nodes for Google Gemini Omni — text-to-video, image-to-video, and video editing via the Gemini Omni API on muapi.ai

We introduce OpenStory++, a large-scale open-domain dataset focusing on enabling MLLMs to perform storytelling generation tasks.

997 playable, source-attributed MiniMax H3 / Hailuo H3 video cases, 309 complete public Prompts, and 13 source-checked guides.

macOS computer-use agent in the notch. Long-press, talk, Claude drives the mouse.

[ICLR'26] SketchThinker-R1: Towards Efficient Sketch-Style Reasoning in Large Multimodal Models

Grounding Language Models for Compositional and Spatial Reasoning

[WACV 2026] Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuning

Identifying reasons for human actions in lifestyle vlogs.

Code and dataset release for "PACS: A Dataset for Physical Audiovisual CommonSense Reasoning" (ECCV 2022)

[ICML'26] Toward Human-like Audio-Visual Intelligence of Omni-MLLMs

[ICLR 2026🔥] SHIELD: Suppressing Hallucinations In LVLM Encoders via Bias and Vulnerability Defense

Multi-Modal Hate Speech Detection using Deep Learning.

Local IAB Content Taxonomy Mapper (2.x → 3.0). Deterministic → fuzzy → optional embeddings. Exports OpenRTB & VAST-ready category IDs with vector attributes and SCD awareness.

Code and data for ACL 2024 paper on 'Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space'

[CVPR 2026] Official repo of UniM

Extract structured data from documents, images, audio, and video using LLMs in Python