Comments (3)
My implementation is based on this one: https://github.com/kan-bayashi/ParallelWaveGAN
It is uses the same spectrogram representation as in espnet: https://github.com/espnet/espnet
So any vocoder from the espnet model zoo that is trained on 22500Hz should work.
from ims-toucan.
Increasing the sampling rate of the generated spectrograms increases the complexity of the task the model has to solve and its runtime requirements, but yes, with clean data it would probably sound better.
Finetuning the vocoder on TTS outputs is done frequently and is known to bring pretty good improvements for removing artifacts. However, then the vocoder becomes specialized for one certain model and loses some of it's generality. Because I want the vocoder to be universal, I don't plan on doing that and finding other solutions instead, but if you want to try it, it probably increases the quality.
from ims-toucan.
I started working on 22.05K sample rate fs2 model, currently preparing dataset in 22K and will try training new model, but I think the Vocoder will not be compatible since it is trained on 16K datasets, but what other Vocoder do you think will work with the configuration of this module, especially how we handle the Stft part since it is also very important for vocoder along with sample rate?
from ims-toucan.
Related Issues (20)
- Handling of abbreviations/ single letters HOT 4
- For info ThisSpeakerDoesNotExist UI on HuggingFace doesn't load HOT 1
- Quality of exact style cloning HOT 1
- Clone a Voice. How to improve? HOT 6
- Nasal ɛ̃ ("in" in French) mispronounced only on female voices (not on male voices) HOT 8
- AttributeError: 'Tag' object has no attribute 'value' HOT 2
- RuntimeError: Input type (torch.cuda.FloatTensor) and weight type (torch.FloatTensor) should be the same HOT 3
- Error pulseaudio
- What'are the goals of the different branches ? HOT 3
- Prosody Cloning Code HOT 2
- Wrong parsing of AISHELL3 text HOT 3
- For info: Toucan doesn't torch.compile() HOT 1
- How to improve unnatural German voice? HOT 1
- Questions about LAML procedure implementation HOT 4
- Size compatability issue when voice cloning HOT 1
- Porting model(s) to mobile (Android) HOT 2
- [Question] Code related to "EXACT PROSODY CLONING IN ZERO-SHOT MULTISPEAKER TEXT-TO-SPEECH" HOT 2
- Adding controlled pauses to the generated speech HOT 2
- Train a Finnish checkpoint from scratch HOT 5
- Memory Overload from Multiple Python Instances During TTS Training: Windows 10 HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ims-toucan.