最有价值项目

A PyTorch implementation of the paper "MMoT: Mixture-of-Modality-Tokens Transformer for Composed Multimodal Conditional Image Synthesis".

A Multimodal Discord bot with machine learning functions, including LLM chat, Image generation, and Speech Generation capabilities

Context Runtime — a database query planner for LLM context. Decides what a model sees before it answers; plans it, runs it through reused substrate, and learns from the outcome.

Open source implementation of a vision transformer that can understand Videos using max vit as a foundation.

This repository contains practical AI projects applying machine learning techniques to real-world problems.

[COLING 2024] TIGER: A Unified Generative Model Framework for Multimodal Dialogue Response Generation

A curated list of papers, benchmarks, project pages, and code for proactive agents.

基于Qwen2.5-VL-3B + QLoRA的智能驾驶场景结构化理解系统

Self-hosted multimodal AI workspace — chat, vision QA, text-to-image, image-to-image in one conversation

Multimodal and multilingual topic model with pretrained embeddings

[NeurIPS2023] LoRA: A Logical Reasoning Augmented Dataset for Visual Question Answering

Unified-modal Salient Object Detection via Adaptive Prompt Learning

It is a chatbot based on LangChain.

[Reproduce] Code for the EMNLP2018 paper "A Visual Attention Grounding Neural Model for Multimodal Machine Translation".

Exploring Visual Interpretability for Contrastive Language-Image Pretraining

Create a supercut montage video with Gemini LLM

Giving Every Modality a Voice in Microservice Failure Diagnosis via Multimodal Adaptive Optimization

Batch LLM Inference with Ray Data LLM: From Simple to Advanced

Open-source local AI server configs, GFX906 runtime maintenance, reproducible benchmarks, and QC methods for affordable AI research infrastructure.

An out-of-tree vLLM plugin for Mobilint NPU runtime integration.