multimodal

The fastest way to put Volcengine Ark in your terminal and your AI agent — go from prompt to generated media, multimodal answer, or deployed endpoint in a single command, no API glue code.

SGS, is a user-friendly, collaborative and versatile browser for visualizing single-cell and spatial multiomics data.

[CVPR 2024] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities

A Codex plugin and local MCP runtime for context-bounded image generation and inspection.

This repository is used to collect papers and code in the field of AI.

DeepSeek Harness (DSH) plugin: dispatch work to DSH agents from Claude Code / Codex — native subagent progress, in-host worker sessions with per-tier presets, and a multimodal bridge that lends the text-only harness vision and image generation.

Use Llama3.2 Vision for tagging and searching images on your local machine.

Implementation of Zorro, Masked Multimodal Transformer, in Pytorch

A JAX Research Toolkit for Visualizing, Manipulating, and Understanding Gemma Models with Multi-modal Support based on Penzai.

World's fastest and most compact embedded vector database: exact by default, multimodal, local-first, and GPU-accelerated

[MICCAI 2024, top 11%] Official Pytorch implementation of Mammo-CLIP: A Vision Language Foundation Model to Enhance Data Efficiency and Robustness in Mammography

[ICLR 2025] 🏄 OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with Transformer

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)

VideoDB Python SDK

🚀 Way Back Home

...short biography

Official implementation of the paper "FLIP: Cross-domain Face Anti-spoofing with Language Guidance". (ICCV 2023)

An all in one AI solution compatible with any known AI service on the planet

Robust multimodal image registration via keypoints

A configurable engine for analysing multi-lingual and multi-modal content.