multimodal

MiniMax H3 全域提示词工程 Skill｜T2VA / I2VA / FL2VA / L2VA / Ref2VA｜50+ 创作玩法｜人物一致性、视频编辑、动作参考、音频控制、广告、短剧、MV、3D、数字人、Prompt 修复｜ComfyUI / RunningHub / Codex

[ACCV 2022] Dataset with 1000+ video advertisemets proposed by "Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Reward"

[ICCV 2025] Know "No" Better: A Data-Driven Approach for Enhancing Negation Awareness in CLIP

An invisible AI desktop assistant that evades screen capture and taskbar detection. Features instant visual analysis, live Whisper voice transcription, and robust support for premium LLMs (Anthropic, OpenAI, OpenRouter, Gemini, and local Ollama).

Multi-Agent Comic Generator powered by the @google-gemini API. Turn simple prompts into comics with AI-generated stories, consistent characters, auto speech bubbles, and 7 language support. Built with FastAPI and deployed on Google Cloud Run.

Billus 大模型技能库：面向 LLM、VL、多模态与图像生成模型的训练、调参、剪枝、量化与工程化技能库

Multimodal Document Processing RAG with LangChain

BobVLM – A 1.5B multimodal model built from scratch and pre-trained on a single P100 GPU capable of image descriptions and moderate question answering. 🤗🎉

7.67× LoRA / 8.35× Full FT speedup for Qwen3.5 (0.8B–27B) on NVIDIA DGX Spark — wall-clock parity with rented H100. Lossless within BF16. Three-command interactive wizard handles model picker, data validator, training, and merge.

Gemma 3 [ Image-text-text ] [ video inference ] [ multi image chat ]

LRCM: Listen to Rhythm, Choose Movements — Autoregressive Multimodal Dance Generation via Diffusion and Mamba

The source code for our Paper: ''Are Multimodal Embeddings Truly Beneficial for Recommendation? A Deep Dive into Whole vs. Individual Modalities''.

This repo contains evaluation code for MM-IQ benchmark.

GDB: GraphicDesignBench - A real-world benchmark for evaluating AI on graphic design tasks

Chain of Images for Intuitively Reasoning

A semantic file retrieval application based on LLM（一个轻量级基于大模型解析的多模态文件语义检索工具，不同于传统基于文件名或metadata检索的方式，该工具可实现基于文件内容的语义检索，支持各类主流格式文档、图片、音频、视频。)

Multimodal Integration with Modality-agnostic Autoencoders - Developed by LMIB @ KU Leuven

Experimental web console for real-time multimodal AI interactions (voice/video) using Gemini 2.0 Live API and NijiVoice. Next.js (TypeScript, Tailwind) frontend and FastAPI backend communicate over WebSocket for low-latency streaming.

I forgot to fork the repo of LineVD project at first so I create this repository to store the current work, I will add the original work link at the readme file

Чат-бот с LLL + RAG