video

Multi-Modal Transformer for Video Retrieval

[EMNLP2024 Demo], [ICASSP 2025], [ICASSP 2026] A user-friendly library for reproducible video moment retrieval and highlight detection. It also supports audio moment retrieval.

General video interaction platform based on LLMs, including Video ChatGPT

Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR 2024 Best Paper]

Recrafting Video Ads with Generative AI

Python API & command-line tool to easily transcribe speech-based video files into clean text

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)

Obsidian plugin to create high-quality transcriptions from markdown linked audio files

VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects

Instantly create video clips from LLM prompts

[IEEE TCSVT'26] 🂡 AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation

Craft your visions

Easiest way of fine-tuning HuggingFace video classification models

Find out who said what in the video.

VideoAlchemy is a toolkit expanding video processing capabilities, emphasizing FFmpeg and broader video technology applications.

VLM driven tool that processes surveillance videos, extracts frames, and generates insightful annotations using a fine-tuned Florence-2 Vision-Language Model. Includes a Gradio-based interface for querying and analyzing video footage.

[ICLR 2026] DecAlign: Hierarchical Cross-Modal Alignment for Decoupled Multimodal Representation Learning

Implementation of a multimodal diffusion transformer in Pytorch

AI-native studio for multi-device shows that happen inside phones.

ACCV 2020 "Speech2Video Synthesis with 3D Skeleton Regularization and Expressive Body Poses"