Code Monkey home page Code Monkey logo

Comments (7)

CorentinJ avatar CorentinJ commented on June 15, 2024

Which alignments did you check? I used default parameters for the textgrid ones, but I applied a cleaning script to get the txt ones. I don't have that script anymore unfortunately.

from librispeech-alignments.

stephenmelsom avatar stephenmelsom commented on June 15, 2024

I checked both just to be sure. I noticed the discrepancy after trying to run my own cleaned alignments through synthesizer preprocessing script in your sv2tts repo. There's an assertion in the split_on_silences function that checks if the first and last words are silences and that's where I errored out.

I'm wondering if there were updates to the MFA that may have caused this.

from librispeech-alignments.

CorentinJ avatar CorentinJ commented on June 15, 2024

Ah right, sorry I didn't remember that until you mentioned it. Yes, I normalized everything in such a way that a sentences ends and starts with a silence, even if it's a 0-duration one. It was just out of convenience, I can't really remember why.

Silences are represented as empty words, e.g. in the first sentence there is a silence from 0s to 0.49s and the word 'GO' is pronounced from 0.49s to 0.89s. Each sentence is guaranteed to start and end with a silence, even if its duration is 0, this is for parsing convenience.

from librispeech-alignments.

stephenmelsom avatar stephenmelsom commented on June 15, 2024

Do you happen to recall (generally) how you normalized those sentences to determine those silences?

from librispeech-alignments.

stray128 avatar stray128 commented on June 15, 2024

Hi @sjmelsom, I want to create alignments on VCTK dataset, and I have no idea how to use the MFA. Is it possible to share your work regarding the creation of alignments?

from librispeech-alignments.

stephenmelsom avatar stephenmelsom commented on June 15, 2024

@stray128 I would recommend that you head over to the MFA docs. They provide a reasonable amount of material that will help you get started.

from librispeech-alignments.

stray128 avatar stray128 commented on June 15, 2024

Thanks, @sjmelsom. Also, I have another question for you. did you train the synthesizer model on the alignments you generated? If so, Were the results good when you surpass the number of steps that @CorentinJ trained?

from librispeech-alignments.

Related Issues (6)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.