multimodal

Swift 6 agent SDK: type-safe tools, streaming, cloud + on-device inference via MLX on Apple Silicon

Code for "Dual-Level Adaptive Incongruity-Enhanced Model for Multimodal Sarcasm Detection".

Blazing fast Go port of gemini-web2api. Convert Google Gemini web into OpenAI-compatible API. Zero cost, single static binary.

Interpreting CLIP with Hierarchical Sparse Autoencoders (ICML 2025)

[CVPR 2026 Main] MultiBanana: A Challenging Benchmark for Multi-Reference Text-to-Image Generation

Ask your video library anything — an AI agent that watches, reasons in a tool-use loop, and answers with playable clips and charts.

[CVPR2025] Official Repository for IMMUNE: Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignment

An advanced Self-Centered Intelligence (SCI) prototype that represents a new paradigm in AI-human interaction.

Next-generation self-evolving multimodal memory brain.

[ICLR 2026] AgilePruner: An Empirical Study of Attention and Diversity for Adaptive Visual Token Pruning in Large Vision-Language Models

[ECCV'24] MaxFusion: Plug & Play multimodal generation in text to image diffusion models

MedMO: Medical Foundation Model

[CVPR 2026 Highlight] ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering

多模态情绪识别方法研究（Multimodal Emotion Recognition）

A comprehensive Go client library for the Perplexity AI API with support for chat completions, async jobs, streaming, multimodal messages, structured outputs, and web search integration

Self-hosted, private family AI health steward. Multimodal AI structures health data into a person-centric profile with dashboard & AI consultation (Feishu/Lark integration). 开源可私有化部署的家庭 AI 健康管家：多模态大模型 + 健康画像看板 + AI 咨询 + 飞书渠道。

Alignment-Free RGBT Salient Object Detection: Semantics-guided Asymmetric Correlation Network and A Unified Benchmark

[Reproduce] Code for the ACL2019 paper "Multimodal Transformer for Unaligned Multimodal Language Sequences".

Real-time video understanding and interaction through text,audio,image and video with large multi-modal model. 利用多模态大模型的实时视频理解和交互框架，通过文本、语音、图像和视频和这是世界进行问答和交流。

Circuitry.ai is an open-source tool that combines computer vision and large language models to detect, analyze, and explain electronic circuit diagrams. It leverages YOLOv8 for component detection and LLaMA 3 for generating intelligent textual explanations of how the circuit works.