1
huggingface / transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
View huggingface/transformersTrending open-source projects · updated daily
Audio GitHub Trending
The audio board covers speech and sound: text-to-speech, speech recognition, voice cloning, music generation, source separation, transcription and audio processing libraries. It is assembled from GitHub topic pages for text-to-speech, speech recognition and music generation and ranked by stars, which makes it a quick survey of where the open-source audio stack currently stands — classic toolkits sit beside this year's model releases. Every entry lists language, stars and forks and opens a detail page with description, license, last push date and README, plus related audio projects. For anyone wiring voice into a product or processing recordings at scale, the activity dates on those pages matter as much as the star counts.
Trending Audio Projects
2
debpalash / VoiceStudio
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
View debpalash/VoiceStudio3
RVC-Boss / GPT-SoVITS
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
View RVC-Boss/GPT-SoVITS4
→5
coqui-ai / TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
View coqui-ai/TTS6
OpenBMB / VoxCPM
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
View OpenBMB/VoxCPM7
→8
myshell-ai / OpenVoice
Instant voice cloning by MIT and MyShell. Audio foundation model.
View myshell-ai/OpenVoice9
babysor / MockingBird
🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time
View babysor/MockingBird10
mozilla / DeepSpeech
DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
View mozilla/DeepSpeech11
→12
m-bain / whisperX
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
View m-bain/whisperX13
index-tts / index-tts
An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
View index-tts/index-tts14
QwenAudio / CosyVoice
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
View QwenAudio/CosyVoice15
modelscope / FunASR
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
View modelscope/FunASR16
nari-labs / dia
A TTS model capable of generating ultra-realistic dialogue in one pass.
View nari-labs/dia17
k2-fsa / sherpa-onnx
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection.
View k2-fsa/sherpa-onnx18
alphacep / vosk-api
Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
View alphacep/vosk-api19
supertone-oss-archive / supertonic
Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.
View supertone-oss-archive/supertonic20
abus-aikorea / voice-pro
Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube download
View abus-aikorea/voice-pro21
multimodal-art-projection / YuE
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
View multimodal-art-projection/YuE22
PaddlePaddle / PaddleSpeech
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System
View PaddlePaddle/PaddleSpeech23
rany2 / edge-tts
Use Microsoft Edge's online text-to-speech service from Python WITHOUT needing Microsoft Edge
View rany2/edge-tts24
→25
→26
QuentinFuxa / WhisperLiveKit
Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.
View QuentinFuxa/WhisperLiveKit27
open-mmlab / Amphion
Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio
View open-mmlab/Amphion28
mozilla / TTS
🤖 💬 Deep learning for Text to Speech (Discussion forum: https://discourse.mozilla.org/c/tts)
View mozilla/TTS29
→30
QwenAudio / SenseVoice
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
View QwenAudio/SenseVoice31
Uberi / speech_recognition
Speech recognition module for Python, supporting several engines and APIs, online and offline.
View Uberi/speech_recognition32
netease-youdao / EmotiVoice
EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine
View netease-youdao/EmotiVoice33
nl8590687 / ASRT_SpeechRecognition
A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统
View nl8590687/ASRT_SpeechRecognition34
Blaizzy / mlx-audio
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
View Blaizzy/mlx-audio35
Plachtaa / VALL-E-X
An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/
View Plachtaa/VALL-E-X36
jaywalnut310 / vits
VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
View jaywalnut310/vits37
myshell-ai / MeloTTS
High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.
View myshell-ai/MeloTTS38
espeak-ng / espeak-ng
eSpeak NG is an open source speech synthesizer that supports more than hundred languages and accents.
View espeak-ng/espeak-ng39
→40
modelscope / FunClip
FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI.
View modelscope/FunClip41
flashlight / wav2letter
Facebook AI Research's Automatic Speech Recognition Toolkit
View flashlight/wav2letter42
→43
yl4579 / StyleTTS2
StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models
View yl4579/StyleTTS244
denizsafak / abogen
Generate audiobooks from EPUBs, PDFs and text with synchronized captions.
View denizsafak/abogen45
snakers4 / silero-models
Silero Models: pre-trained text-to-speech models made embarrassingly simple
View snakers4/silero-models46
dograh-hq / dograh
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.
View dograh-hq/dograh47
liuzhao1225 / YouDub-webui
Open-source AI video localization and dubbing for YouTube/Bilibili: speech recognition, subtitle translation, voice cloning, audio mixing and rendering. 开源 AI 视频翻译配音工具。
View liuzhao1225/YouDub-webui48
MahmoudAshraf97 / whisper-diarization
Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper
View MahmoudAshraf97/whisper-diarization49
remsky / Kokoro-FastAPI
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, optional readalong web UI
View remsky/Kokoro-FastAPI50
wenet-e2e / wenet
Production First and Production Ready End-to-End Speech Recognition Toolkit
View wenet-e2e/wenet51
AhmadHassan-BTed / B
An autonomous, context-aware AI desktop companion. Built with Python, featuring real-time screen vision, custom ONNX voice synthesis, active window tracking
View AhmadHassan-BTed/B52
fspecii / ace-step-ui
🎵 The Ultimate Open Source Suno Alternative - Professional UI for ACE-Step 1.5 AI Music Generation. Free, local, unlimited. Stop paying for Suno!
View fspecii/ace-step-ui53
Picovoice / porcupine
On-device wake word detection powered by deep learning
View Picovoice/porcupine54
MoonInTheRiver / DiffSinger
DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code
View MoonInTheRiver/DiffSinger55
jianchang512 / stt
Voice Recognition to Text Tool / 一个离线运行的本地音视频转字幕工具，输出json、srt字幕、纯文字格式
View jianchang512/stt56
sanchit-gandhi / whisper-jax
JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.
View sanchit-gandhi/whisper-jax57
OpenMOSS / MOSS-TTS-Nano
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
View OpenMOSS/MOSS-TTS-Nano58
→59
→60
OpenMOSS / MOSS-TTS
An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS
View OpenMOSS/MOSS-TTS61
metavoiceio / metavoice-src
Foundational model for human-like, expressive TTS
View metavoiceio/metavoice-src62
→63
huggingface / distil-whisper
Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.
View huggingface/distil-whisper64
→65
TensorSpeech / TensorFlowTTS
😝 TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)
View TensorSpeech/TensorFlowTTS66
0xShug0 / audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance.
View 0xShug0/audio.cpp67
IAHispano / Applio
A simple, high-quality voice conversion tool focused on ease of use and performance.
View IAHispano/Applio68
ahmetoner / whisper-asr-webservice
OpenAI Whisper ASR Webservice API
View ahmetoner/whisper-asr-webservice69
rsxdalv / TTS-WebUI
A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet
View rsxdalv/TTS-WebUI70
Purfview / whisper-standalone-win
Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.
View Purfview/whisper-standalone-win71
chenyme / Chenyme-AAVT
这是一个全自动（音频）视频翻译项目。利用Whisper识别声音，AI大模型翻译字幕，最后合并字幕视频，生成翻译后的视频。
View chenyme/Chenyme-AAVT72
HeyWillow / willow
Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative
View HeyWillow/willow73
QwenAudio / qwen-audio-agent
A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents
View QwenAudio/qwen-audio-agent74
pluja / whishper
Transcribe any audio to text, translate and edit subtitles 100% locally with a web UI. Powered by whisper models!
View pluja/whishper75
pnnbao97 / VieNeu-TTS
Vietnamese TTS with instant voice cloning • On-device • Real-time CPU inference • 48kHz audio quality • Chuyển văn bản thành giọng nói tiếng Việt • Text to speech tiếng Việt • TTS tiếng Việt
View pnnbao97/VieNeu-TTS76
AutoArk / GPA
[AutoArk] GPA (General Purpose Audio) can do ASR, TTS and voice conversion with one tiny model!
View AutoArk/GPA77
→78
readbeyond / aeneas
aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)
View readbeyond/aeneas79
linto-ai / whisper-timestamped
Multilingual Automatic Speech Recognition with word-level timestamps and confidence
View linto-ai/whisper-timestamped80
zzw922cn / Automatic_Speech_Recognition
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
View zzw922cn/Automatic_Speech_Recognition81
→82
→83
pndurette / gTTS
Python library and CLI tool to interface with Google Translate's text-to-speech API
View pndurette/gTTS84
coqui-ai / STT
🐸STT - The deep learning toolkit for Speech-to-Text. Training and deploying STT models has never been so easy.
View coqui-ai/STT85
marytts / marytts
MARY TTS -- an open-source, multilingual text-to-speech synthesis system written in pure java
View marytts/marytts86
→87
jik876 / hifi-gan
HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis
View jik876/hifi-gan88
OpenMOSS / MOSS-Transcribe-Diarize
A 0.9B model for long-form transcription in 50+ languages with speaker diarization, timestamps, and acoustic event awareness
View OpenMOSS/MOSS-Transcribe-Diarize89
lifeiteng / vall-e
PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech), Reproduced Demo https://lifeiteng.github.io/valle/index.html
View lifeiteng/vall-e90
DigitalPhonetics / IMS-Toucan
Controllable and fast Text-to-Speech for over 7000 languages!
View DigitalPhonetics/IMS-Toucan91
→92
pannous / tensorflow-speech-recognition
🎙Speech recognition using the tensorflow deep learning framework, sequence-to-sequence neural networks
View pannous/tensorflow-speech-recognition93
react-native-voice / voice
🎤 React Native Voice Recognition library for iOS and Android (Online and Offline Support)
View react-native-voice/voice94
travisvn / openai-edge-tts
Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs
View travisvn/openai-edge-tts95
→96
leemysw / yovoice
Open-source local AI audio & music studio for macOS & Windows. TTS, voice cloning, songs with lyrics, and multi-track scores — 100% offline, zero API fees.
View leemysw/yovoice97
FireRedTeam / FireRedASR
Open-source industrial-grade ASR models supporting Mandarin, Chinese dialects and English, achieving a new SOTA on public Mandarin ASR benchmarks
View FireRedTeam/FireRedASR98
→99
julius-speech / julius
Open-Source Large Vocabulary Continuous Speech Recognition Engine
View julius-speech/julius100
astorfi / lip-reading-deeplearning
🔓 Lip Reading - Cross Audio-Visual Recognition using 3D Architectures
View astorfi/lip-reading-deeplearningSpeech AI GitHub Projects
- debpalash/VoiceStudio — ★ 99,574
- RVC-Boss/GPT-SoVITS — ★ 64,680
- ggml-org/whisper.cpp — ★ 54,881
- coqui-ai/TTS — ★ 46,180
- OpenBMB/VoxCPM — ★ 40,990
- 2noise/ChatTTS — ★ 39,977
- myshell-ai/OpenVoice — ★ 38,131
- babysor/MockingBird — ★ 36,880
Text-to-Speech Repositories
- index-tts/index-tts — ★ 24,908
- nari-labs/dia — ★ 19,410
- k2-fsa/sherpa-onnx — ★ 15,704
- supertone-oss-archive/supertonic — ★ 13,757
- abus-aikorea/voice-pro — ★ 13,394
- PaddlePaddle/PaddleSpeech — ★ 12,702
- rany2/edge-tts — ★ 12,446
- mozilla/TTS — ★ 10,179
Audio Processing Tools
- huggingface/transformers — ★ 168,486
- QwenAudio/CosyVoice — ★ 24,258
- multimodal-art-projection/YuE — ★ 13,033
- open-mmlab/Amphion — ★ 10,329
- QwenAudio/SenseVoice — ★ 9,679
- Blaizzy/mlx-audio — ★ 8,189
- denizsafak/abogen — ★ 6,189
- liuzhao1225/YouDub-webui — ★ 5,792
More GitHub Trending Projects
1
→2
→3
→4
→5
→6
→