multimodal

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

[ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point Clouds

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

Eyes for text-only DeepSeek Harness agents: built-in free vision chain (no key) + pixel-level vision tools (Q&A, grounding, crop, pixel diff, colors, OCR, SVG trace, cutout, screenshots). One-command install, no Python, image turns work like ordinary tool-calling turns.

TongFlow — Multimodal GenAI Studio

SGLang-Omni empowers high-performance serving for TTS, ASR, speech and omni models.

RAG Time: A 5-week Learning Journey to Mastering RAG

About This repository is a curated collection of the most exciting and influential CVPR 2025 papers. 🔥 [Paper + Code + Demo]

NEO Series: Native Vision-Language Models from First Principles

⚡ Self-hostable YesCaptcha-compatible captcha solver built with FastAPI, Playwright, and OpenAI-compatible multimodal models.

Multimodal RL training framework for diffusion & omni models

A simple, unified multimodal models training engine. Lean, flexible, and built for hacking at scale.

[TMLR 2025🔥] A survey for the autoregressive models in vision.

library supporting NLP and CV research on scientific papers

Train Models Contrastively in Pytorch

Paper list about multimodal and large language models, only used to record papers I read in the daily arxiv for personal needs.

本地监控 + AI 视觉 — LAN-based smartphone-powered AI monitoring framework with structured event output for data acquisition and analysis.