Skip to content

ai4s-research/awesome-text-to-speech

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Awesome Text-to-Speech

🔊 Awesome Text-to-Speech (TTS)

A curated list of the best Text-to-Speech, speech synthesis, and voice-cloning research — models, papers, benchmarks, and toolkits, with a focus on 2025–2026.

Awesome License: MIT GitHub Stars GitHub Forks Last Commit


Text-to-speech (TTS) has shifted from pipeline acoustic models to codec language models, flow matching, and full-duplex speech LLMs. This list tracks the models, papers, codecs, benchmarks, and toolkits that matter — with a bias toward 2025–2026 work and open weights you can actually run.

Found a great model or paper we missed? Contributions welcome.


📚 Contents

📖 Surveys & Overviews

🚀 Zero-shot & Large-scale TTS Models

Foundational

2025-2026 flagship systems

🧬 Voice Cloning & Speaker Adaptation

🎭 Expressive, Controllable & Emotional TTS

⚡ Streaming, Real-time & Efficient TTS

🌍 Multilingual & Low-resource TTS

🔊 Neural Audio Codecs

🎤 Singing Voice Synthesis

📊 Benchmarks & Datasets

Datasets

Benchmarks & Metrics

🛠️ Open-source Toolkits & Implementations

  • coqui-ai/TTS — The de-facto open TTS library (Tacotron2, VITS, XTTS); upstream is now in maintenance mode after Coqui shut down but still heavily used (ongoing).
  • espnet/espnet — End-to-end speech toolkit (ASR/TTS/ST) with hundreds of reproducible recipes; the academic reference implementation (ongoing).
  • NVIDIA-NeMo/NeMo — NVIDIA's scalable generative-AI framework with production-grade ASR/TTS; the canonical path is now NVIDIA-NeMo/NeMo (old NVIDIA/NeMo redirects) (ongoing).
  • speechbrain/speechbrain — A clean, modular PyTorch all-in-one toolkit with 200+ recipes and 100+ pretrained models (ongoing).
  • open-mmlab/Amphion — Audio/music/speech generation toolkit for reproducible research; consolidates many modern TTS/VC systems (MaskGCT, Vevo) in one place (ongoing).
  • SWivid/F5-TTS — Reference implementation of F5-TTS; the leading 2024-era open flow-matching cloner (weights CC-BY-NC) (2024).
  • FunAudioLLM/CosyVoice — Alibaba's multilingual large voice-generation model with a full train/infer/deploy stack and active v3 releases (ongoing).
  • fishaudio/fish-speech — Multilingual dual-autoregressive TTS trained on 10M+ hours; strong quality under a restrictive research license (ongoing).
  • resemble-ai/chatterbox — Resemble AI's MIT-licensed SoTA TTS: 23+ languages plus low-latency turbo variants and built-in watermarking (ongoing).
  • hexgrad/kokoro — Inference library for Kokoro-82M, a tiny Apache-licensed model punching far above its weight; a favorite for edge/local TTS (2025).
  • neonbjb/tortoise-tts — Quality-first autoregressive multi-voice TTS; slow but historically influential for expressive cloning (2022).
  • suno-ai/bark — Transformer text-to-audio generating speech plus nonverbal sounds/music; MIT-licensed and widely forked (2023).
  • OHF-Voice/piper1-gpl — Actively-maintained successor to Piper, a fast fully-local neural TTS engine (the legacy rhasspy/piper is archived) (ongoing).

💼 Commercial & Closed Systems

Closed but field-defining — listed for completeness; no weights, API-only.

  • ElevenLabs Eleven v3 — The most expressive commercial TTS of the cycle: inline audio tags for emotion/delivery and 70+ languages (2025).
  • OpenAI gpt-realtime / next-gen audio — OpenAI's steerable speech-to-speech and gpt-4o-mini-tts models powering real-time voice agents (2025).
  • Cartesia Sonic 3 — State-space-model TTS with sub-100 ms streaming; the latency leader for voice agents (2025).

📑 Related Awesome Lists


🤝 Contributing

Contributions are welcome! See CONTRIBUTING.md. In short: add your entry to the right section using - [Title](URL) — note (year)., verify the link resolves, and open a PR.

📄 License

MIT for the curation itself. Linked resources remain under their own licenses.


Star ⭐ this repo if it helps you keep up with text-to-speech.

About

A curated list of the best Text-to-Speech, speech synthesis, and voice-cloning research — models, papers, benchmarks, and toolkits, focused on 2025–2026.

Topics

Resources

Contributing

Stars

Watchers

Forks

Releases

Packages

Contributors