multimodal

[CVPR 2021] SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Events

<만들면서 배우는 생성 AI 2판>의 코드 저장소

Open-source AI backend control plane for model routing, agent tools, OpenAI-compatible APIs, and private workspaces.

[CSUR'24] Multimodal Recommender Systems: A Survey

vision language models finetuning notebooks & use cases (Medgemma - paligemma - florence .....)

[ICLRW 2024] Efficient Remote Sensing with Harmonized Transfer Learning and Modality Alignment

Graph Distillation for Action Detection

Fact-Verified Travel AI Agent

Open-source, local-first desktop AI agent for voice, gesture, gaze, browser and system automation with permission gates and verification.

ADvISER is a flexible framework to encourage task-oriented dialog system research & development

Open-source, customizable frontend for Venice AI. Chat, image gen, audio, video, embeddings + visual workflows — all in one UI. Your API key, your browser, no backend.

MODUS: Decoder-only Any-to-Any Modeling of Diverse Modalities [ICML 2026]

The World's Largest Decentralized AGI Multimodal Dataset

B站视频分析助手：提取字幕/评论/关键帧并生成深度分析报告。

🖼【多模态文档预览插件（纯本地版，效果和兼容性更好，可适配存储）】跨平台支持Office(docx/xlsx/pptx) / WPS / iWork / PDF / CAD / 代码文档、图片、视频、音频、压缩包等大部分文件的预览 A local multimodal previewer for most kinds of documents.

RLLaVA is a user-friendly framework for multi-modal RL research and optimized for resource-constrained teams.

Pytorch Implementation of "Adaptive Co-attention Network for Named Entity Recognition in Tweets" (AAAI 2018)

[ICCV 2025] Official Implementation of "ProLearn: Alleviating Textual Reliance in Medical Language-guided Segmentation via Prototype-driven Semantic Approximation"

[TMLR 2026] A Survey of Reasoning and Agentic Systems in Time Series with Large Language Models

Multimodal Dataset of Freezing of Gait in Parkinson's Disease