speech-processing

A PyTorch-based Speech Toolkit

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

Become a cracked AI/ML researcher/engineer with this unconventional textbook covering maths, computing, and ML with intuition.

Reading list for research topics in multimodal machine learning

Foundation Architecture for (M)LLMs

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

Controllable and fast Text-to-Speech for over 7000 languages!

PyTorch implementation of convolutional neural networks-based text-to-speech synthesis models

A curated list of awesome Speaker Diarization papers, libraries, datasets, and other resources.

💎 A list of accessible speech corpora for ASR, TTS, and other Speech Technologies

StreamSpeech is an “All in One” seamless model for offline and simultaneous speech recognition, speech translation and speech synthesis.

The SpeechBrain project aims to build a novel speech toolkit fully based on PyTorch. With SpeechBrain users can easily create speech processing systems, ranging from speech recognition (both HMM/DNN and end-to-end), speaker recognition, speech enhancement, speech separation, multi-microphone speech processing, and many others.

Cross-platform, real-time, offline speech recognition plugin for Unreal Engine. Based on Whisper OpenAI technology, whisper.cpp.

General Speech Restoration

Phoneme Recognition using pre-trained models Wav2vec2, HuBERT and WavLM. Throughout this project, we compared specifically three different self-supervised models, Wav2vec (2019, 2020), HuBERT (2021) and WavLM (2022) pretrained on a corpus of English speech that we will use in various ways to perform phoneme recognition for different languages with a network trained with Connectionist Temporal Classification (CTC) algorithm.

Auto transcribe tool based on whisper

RETIRED - OpenSTT is now retired. If you would like more information on Mycroft AI's open source STT projects, please visit:

Google's SoundStorm: Efficient Parallel Audio Generation

Java SDK for ElevateAI

Real-time Voice Activity Detection (VAD) with some example use case like simple voice bot and live transcription (realtime transcription)