最有价值项目

Grounding Language Models for Compositional and Spatial Reasoning

[WACV 2026] Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuning

Identifying reasons for human actions in lifestyle vlogs.

Code and dataset release for "PACS: A Dataset for Physical Audiovisual CommonSense Reasoning" (ECCV 2022)

[ICML'26] Toward Human-like Audio-Visual Intelligence of Omni-MLLMs

[ICLR 2026🔥] SHIELD: Suppressing Hallucinations In LVLM Encoders via Bias and Vulnerability Defense

Multi-Modal Hate Speech Detection using Deep Learning.

Local IAB Content Taxonomy Mapper (2.x → 3.0). Deterministic → fuzzy → optional embeddings. Exports OpenRTB & VAST-ready category IDs with vector attributes and SCD awareness.

Code and data for ACL 2024 paper on 'Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space'

Open Translator: Speech To Speech and Speech to text Translator with voice cloning and other cool features

[CVPR 2026] Official repo of UniM

Extract structured data from documents, images, audio, and video using LLMs in Python

This repo contains the original implementation of VAuLT, the Vision-and-Augmented-Language Transformer. We provide instructions to download some multimodal social-media datasets, and scripts to experiment with. VAuLT is a stack of Transformers, a LM like BERT that preprocesses the text input of ViLT

[IEEE TMM 2024] IGReg: Image-Geometry-Assisted Point Cloud Registration via Selective Correlation Fusion

This is the official repository for CardioLab. A machine and deep learning framework for the estimation and monitoring of laboratory abnormalities throught ECG data.

Road Maps as Free Geometric Priors: Weather-Invariant Drone Geo-Localization with GeoFuse

Streaming on-device speech recognition for Android — NEON-accelerated FastConformer (32M params), cache-aware streaming with 80 ms look-ahead, no cloud. Powered by the VoxRT runtime.

Sonori is a fully local STT app for Linux (Wayland).

Identifying individual speakers in an audio stream based on the unique characteristics found in individual voices using Python

Rev.ai Java SDK