audio

Python API & command-line tool to easily transcribe speech-based video files into clean text

收集有关so-vits-svc、TTS、SD、LLMs的各种模型、应用以及文字、声音、图片、视频有关的model。

A collection of Audio and Speech pre-trained models.

OFASys: A Multi-Modal Multi-Task Learning System for Building Generalist Models

VideoAlchemy is a toolkit expanding video processing capabilities, emphasizing FFmpeg and broader video technology applications.

Timething is a library for aligning text transcripts with their audio recordings.

Your one-stop solution for voice dataset creation

PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)

ElevateAI - Speech-to-text API Python SDK

Implementation of a multimodal diffusion transformer in Pytorch

Transcribe your audio to text with this serverless component

Docker image for a self-hosted Whisper speech-to-text server with speaker diarization and OpenAI-compatible transcription and translation APIs. Powered by faster-whisper. Supports all Whisper models, NVIDIA GPU (CUDA) acceleration, JSON/SRT/VTT output, SSE streaming, offline mode, and multi-arch (amd64, arm64).

An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.

Awesome Audio-Visual Intelligence, Survey of Audio-Visual Intelligence

Agent-first CLI for audio/video transcription via Whisper

Make Music Unlearnable for Generative AI.

A WebRTC-native, audio-first conversational-AI framework for Go.

Real time audio to audio translation over sockets. With virtual microphones, you can use this in any video conferencing software you'd like!

Repository for the paper "Combining audio control and style transfer using latent diffusion", accepted at ISMIR 2024

Sample Unity project used to demonstrate Speech Recognition using the new Microsoft Speech Service (Preview) via WebSockets.