最有价值项目

제주어, 표준어 양방향 음성 번역 모델 생성 프로젝트 (알고리즘 | 비정형 | NLP | 딥러닝 | 기계번역 | 음성인식 | 멀티모달)

Multi-modal Human Mesh Recovery (SMPL) using image and LiDAR data

A multimodal SER project combining BERT and ECAPA-TDNN with cross-attention-based fusion on the IEMOCAP dataset.

Experiments with multimodal deep learning models based on transformers

FiftyOne Plugin for searching images by audio clip using ImageBind and Qdrant

Robot VLM and VLA (Vision-Language-Action) inference API helping you manage multimodal prompts, RAG, and location metadata

Large Language Model in combination with Large Vision Model for the task of code generation given design sketch.

A full-modal personal knowledge base built on the Karpathy LLM Wiki concept.

[🔥 ICLR 2026] - Misaligned Roles, Misplaced Images: Structural Input Perturbations Expose Multimodal Alignment Blind Spots

Elysium Knowledge Repository is an open source initiative to embed all of Humanity's multi-modal knowledge and wisdom.

Aster describes what a lecture video shows but never says, so blind and low-vision students can follow it

This project is a multi-modal AI voice assistant that uses LM Studio, OpenAI API or Claude Code, audio processing with WhisperModel, speech recognition, clipboard extraction, and image processing to respond to user prompts.

7.67× LoRA / 8.35× Full FT speedup for Qwen3.5 (0.8B–27B) on NVIDIA DGX Spark — wall-clock parity with rented H100. Lossless within BF16. Three-command interactive wizard handles model picker, data validator, training, and merge.

The official implement of Unified Reasoning Emotion Generalist OneEmo

Single-agent multi-modal system for insurance damage claim verification. #1 globally, HackerRank Orchestrate June 2026 (15,295 registrants). Anthropic, OpenAI, Groq, and Gemini support with a deterministic safety gate

Token-lean web microfetch for LLM agents: any URL → clean markdown via CLI, MCP server, and Claude Code plugin. Real browser-cookie auth, passkeys, anti-bot reach, on-by-default prompt-injection defense, plus on-device multimodal ASR/OCR. A single Rust binary — not a browser.

The code and data for "Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization"

ArtSeek: Deep artwork understanding via multimodal in-context reasoning and late interaction retrieval

Dsh-visual-plugin.Give your text-only model eyes: forward user images to any OpenAI-compatible vision model and see the results in a Web UI right panel

LeManchot-Analysis is a system for abnormal detection in coupled visible-thermal images