audio-visual - GitHub 开源项目专题

1

NoizAI/HelixWorld

🪐 HelixWorld: real-time interactive audio-visual world model.

Python ⭐ 199 ⑂ 20 Apache-2.0 · 5 天前推送

generative-ai realtime

5 天前

最近推送

2

guyyariv/TempoTokens

[AAAI 2024] The official PyTorch implementation of "Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptation"

Python ⭐ 131 ⑂ 14 MIT · 2026-05-19推送

ai-art deep-learning

2026-05-19

最近推送

3

JavisVerse/Awesome-AVI

Awesome Audio-Visual Intelligence, Survey of Audio-Visual Intelligence

⭐ 86 ⑂ 2 · 2026-05-08推送

audio large-language-models

2026-05-08

最近推送

4

HarryHsing/OmniAgent

OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewer frames on LVBench.

Python ⭐ 67 ⑂ 6 Apache-2.0 · 13 天前推送

agent llm-agent

13 天前

最近推送

5

joannahong/AV-RelScore

Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring" in CVPR23

Python ⭐ 35 ⑂ 2 · 2023-06-21推送

multimodal avsr

2023-06-21

最近推送

6

georgesterpu/Taris

Transformer-based online speech recognition system with TensorFlow 2

Python ⭐ 26 ⑂ 6 MPL-2.0 · 2021-01-22推送

deep-learning multimodal

2021-01-22

最近推送

7

FudanCVL/AVI-Bench

[ICML'26] Toward Human-like Audio-Visual Intelligence of Omni-MLLMs

Python ⭐ 18 ⑂ 0 NOASSERTION · 2026-06-20推送

agent benchmark

2026-06-20

最近推送

8

ZijunCui02/AV-Phys

Project page for AV-Phys Bench: Do Joint Audio-Video Generation Models Understand Physics?

Python ⭐ 11 ⑂ 2 · 2026-07-17推送

audio-generation benchmark

2026-07-17

最近推送