Comments (6)
It is exposed through the voice_seed
argument of the read
method of the ControllableInterface
class, see :
See https://github.com/DigitalPhonetics/IMS-Toucan/blob/ControllableMultilingual/run_gradio_demo.py for an example usage of that class.
from ims-toucan.
It is exposed through the
voice_seed
argument of theread
method of theControllableInterface
class, see :See https://github.com/DigitalPhonetics/IMS-Toucan/blob/ControllableMultilingual/run_gradio_demo.py for an example usage of that class.
can you give me an example?
from ims-toucan.
I did training in 2 languages, each with 2 speakers: male and female. How do I make it so that during inference I can choose the speakers I will use? Because I only understand that to replace the speakers we can use the audio reference
from ims-toucan.
There is no fixed list of speakers, there are theoretically infinite speakers possible. To change the voice, you first create a Inference Interface using a multispeaker model
and then call the set utterance embedding method on the interface
As argument it takes a filepath to a reference audio, which it will then load and extract an embedding. This embedding is then used as conditioning signal during inference. To change between the two speakers in your data, just call the set utterance embedding method and pass in one of the samples from the dataset from one of the speakers.
from ims-toucan.
There is no fixed list of speakers, there are theoretically infinite speakers possible. To change the voice, you first create a Inference Interface using a multispeaker model
and then call the set utterance embedding method on the interface
As argument it takes a filepath to a reference audio, which it will then load and extract an embedding. This embedding is then used as conditioning signal during inference. To change between the two speakers in your data, just call the set utterance embedding method and pass in one of the samples from the dataset from one of the speakers.
Thank you for your reply. For this line how to use the language
if I use multilingual models?
from ims-toucan.
You can either set the language when you create the inference interface object, but you can also change it later with the set_language method of the inference object:
from ims-toucan.
Related Issues (20)
- raining Issue: Reconstruction Loss Resets After Some Epochs HOT 2
- Dependencies Conflicts HOT 14
- Error when passing a reference_speaker in read_texts function after installing Toucan as described in issue #171 HOT 21
- Error when trying to run an example with Kyrgyz HOT 2
- License clarification for dataset and weights HOT 2
- Typographical Error in README.md HOT 1
- NO module name Architectures. I am trying to train on a new language. HOT 13
- Inquiry about Testing for Chinese Dialects HOT 2
- Voice cloning not working HOT 3
- unable to do voice cloning with arabic HOT 3
- I am not able to find Indian-english accent ("en-in"). HOT 1
- Question Regarding Device Specs HOT 1
- Which recipe to use for training from scratch? HOT 7
- English to another language synthesis HOT 4
- Nancy availability? HOT 2
- Inference speed HOT 2
- Minor issue: the requirements.txt file is encoded as a UTF-16
- New issue after upgrading to new version HOT 1
- Aligner stage: RuntimeError: element 0 of tensors does not require grad
- Finetuning doesn't produce better results
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ims-toucan.