multimodal

(ෆ`꒳´ෆ) A Survey on Text-to-Image Generation/Synthesis.

SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.

GenAI Processors is a lightweight Python library that enables efficient, parallel content processing.

Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.

On-device, real-time multimodal AI with features similar to GPT-Live

[ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.

An open-source implementaion for fine-tuning Qwen-VL series by Alibaba Cloud.

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ.

The Self-Coding System for Your App — Alan AI SDK for Android

The Self-Coding System for Your App — Alan AI SDK for Flutter

The Self-Coding System for Your App — Alan AI SDK for Ionic

Meta-Transformer for Unified Multimodal Learning

Unified multimodal backend for AI data apps

Fast Multimodal LLM on Mobile Devices

Get clean data from tricky documents, powered by vision-language models ⚡