VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech

0. This repository aims to implement a VITS-based zero-shot TTS system varying with diverse style/speaker conditioning methods.
1. To remove the secondary elements, we simply extract a style representation by jointly training a reference encoder from StyleSpeech. In detail, 1. we do not utilize pretrained models (e.g., Link1, Link2) as the reference encoder, 2. we do not apply meta-learning or speaker verification loss during training.
2. LibriTTS dataset (train-clean-100 and train-clean-360) is used for training.

• master
• transfer
• s1
• s2

0. Python >= 3.6
1. Clone this repository
2. Install python requirements. Please refer requirements.txt
   1. You may need to install espeak first: apt-get install espeak
3. Download datasets
4. Build Monotonic Alignment Search and run preprocessing if you use your own datasets.

# Cython-version Monotonoic Alignment Search
cd monotonic_align
python setup.py build_ext --inplace

python train_zs.py -c configs/libritts_base.json -m libritts_base

See inference.ipynb