How could I add Romanian Support for Tacotron 2?

[TheDevloper2023]

I want Romanian TTS, and most options cost me money and sound robotic. I noticed that Tacotron2 has GSTs , VAE, and the outputs are really neutral.

[eginhard]

See https://coqui-tts.readthedocs.io/en/latest/extension/implementing_a_new_language_frontend.html and https://coqui-tts.readthedocs.io/en/latest/training/training_a_model.html

[TheDevloper2023]

Can't I use espeak's phonemizer? It had an option for Romanian.

[eginhard]

Yes, Espeak will be used by default (that first page is not very comprehensive, sorry). You can e.g. adapt the config here:

coqui-ai-TTS/recipes/thorsten_DE/tacotron2-DDC/train_tacotron_ddc.py

Lines 55 to 57 in c0749fb

	text_cleaner="multilingual_phoneme_cleaners",
	use_phonemes=True,
	phoneme_language="de",

[TheDevloper2023]

But will I have to train from scratch or could I finetune using an english pretrain and ignore some layers?

[eginhard]

These are small models, so it's better to train from scratch. But you can start with a pretrained vocoder. and only train or fine-tune your own later if necessary.

[TheDevloper2023]

Thank you so much for your assistance