multimodal

Code for paper "Semantic Diversity-aware Prototype-based Learning for Unbiased Scene Graph Generation (ECCV 2024)"

Official Repository for the paper 'MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification' @ EMNLP 2024

Local NotebookLM for Claude Code via Google Antigravity (agy / Gemini 3.x): /agy:notebook turns a folder of documents into per-doc summaries + a relevance index + a cited synthesis + Q&A. Plus audio/video transcription, deep web research with citations & branded HTML reports. 13 commands, no Node runtime.

Use your X Premium or SuperGrok subscription in pi.

[AAAI 2026] Offical implementation of "Commonality in Few: Few-Shot Multimodal Anomaly Detection via Hypergraph-Enhanced Memory".

Code for Findings of ACL 2022 Paper "Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors"

Access 100s of LLMs with minimal lines of code

StreamUni is a framework that efficiently enables unified Large Speech-Language Models to accomplish streaming speech translation in a cohesive manner.

The AI-native editor for multimodal creation

[ACL-IJCNLP 2021] Self-Supervised Multimodal Opinion Summarization

AI-Powered OSINT Image Analysis

[ISPRS P&RS 2023] Official Python Implementation of Fourier domain structural relationship analysis for unsupervised multimodal change detection

An alternative EQA paradigm and informative benchmark + models (BMVC 2019, ViGIL 2019 spotlight)

This repository contains the official code for our paper: Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucination

Automate the creation of soccer match highlights with the power of Generative AI and AWS. This solution leverages AWS Bedrock (Anthropic’s Claude 3 Sonnet model), AWS MediaConvert, Lambda, Step Functions and other AWS services to identify and compile exciting game moments without manual editing.

Search knowledge by what documents mean and how they look — not one or the other.

AESTETIK: Convolutional autoencoder for learning spot representations from spatial transcriptomics and morphology data

A Benchmark Dataset for Multimodal Scientific Fact Checking

[ICML 2025] Efficiently Serving Large Multimodal Models Using EPD Disaggregation

EVA: Efficient Reinforcement Learning for End-to-End Video Agent