Star 总榜

The source code for our Paper: ''Are Multimodal Embeddings Truly Beneficial for Recommendation? A Deep Dive into Whole vs. Individual Modalities''.

This repo contains evaluation code for MM-IQ benchmark.

GDB: GraphicDesignBench - A real-world benchmark for evaluating AI on graphic design tasks

Chain of Images for Intuitively Reasoning

A semantic file retrieval application based on LLM（一个轻量级基于大模型解析的多模态文件语义检索工具，不同于传统基于文件名或metadata检索的方式，该工具可实现基于文件内容的语义检索，支持各类主流格式文档、图片、音频、视频。)

Multimodal Integration with Modality-agnostic Autoencoders - Developed by LMIB @ KU Leuven

Experimental web console for real-time multimodal AI interactions (voice/video) using Gemini 2.0 Live API and NijiVoice. Next.js (TypeScript, Tailwind) frontend and FastAPI backend communicate over WebSocket for low-latency streaming.

I forgot to fork the repo of LineVD project at first so I create this repository to store the current work, I will add the original work link at the readme file

Чат-бот с LLL + RAG

A serverless invite-only AI-powered chat bot on Telegram.

Google Earth Engine tool to generate multi-modal and multi-temporal datasets, including spatially and temporally aligned Sentinel-1 SAR data, Sentinel-2 multispectral data, weather and DEM-based data. A supplementary material for Paluba et al. 2024: "Identification of Optimal Sentinel-1 SAR Polarimetric Parameters for Forest Monitoring in Czechia

A new optimizer, Gradient Ascent: Gradient Ascent adjusts the parameters in the direction of the gradient to maximize some objective function.

Multimodal data alignment and cell type analysis with coupled autoencoders.

Official PyTorch implementation for "Where You Edit is What You Get: Text-Guided Image Editing with Region-Based Attention" (Pattern Recognition)

Real time video generation

Codebase for the paper titled 'A Shared Encoder Approach to Multimodal Representation Learning'

Official codebase for RetFiner: A Vision-Language Refinement Scheme for Retinal Foundation Models

A visual, web-based programming language and AI notebook: compute, compose, converse.

A local personal memory lab with programmable fractal search and evidence governance.

A voice assistant with local LLM as a backend