Comments (7)
Rpersie
commented on May 19, 2024
The trained model is offline so it can not directly be used for online speech recognition. it requires the models to be trained with online CMN or something like that. Then use the kaldi-online decoder. You can find some online issues on kaldi
kaldi-asr/kaldi#2801
from pytorch-kaldi.
mravanelli
commented on May 19, 2024
The current version natively supports off-line speech recognition only. As
outlined by @Rpersie working on on-line ASR requires different
normalization and decoding strategies. We plan to support on-line ASR in
one of the future version of the toolkit.
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
Virus-free.
www.avast.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
…On Sun, 24 Feb 2019 at 22:38, Rpersie ***@***.***> wrote:
The trained model is offline so it can not directly be used for online
speech recognition. it requires the models to be trained with online CMN or
something like that. Then use the kaldi-online decoder. You can find some
online issues on kaldi
kaldi-asr/kaldi#2801 <kaldi-asr/kaldi#2801>
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#56 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AQGs1iqs-QMhuXwanfY7m67Mri35sm_qks5vQ1qxgaJpZM4bPAmE>
.
from pytorch-kaldi.
Johe-cqu
commented on May 19, 2024
thank you! Looking forward to your update！
from pytorch-kaldi.
Johe-cqu
commented on May 19, 2024
@Rpersie thank you!
from pytorch-kaldi.
Johe-cqu
commented on May 19, 2024
@mravanelli @Rpersie By the way, Why on-line ASR requires different normalization and decoding strategies? It requires faster decoding speed？
from pytorch-kaldi.
Rpersie
commented on May 19, 2024
As the offline cmvn is the mean and var of all frames，in the online mode you can not get all the frames. If you just do the online-cmvn, this will bring the mismatch between the training and test. As for decoding, the feats are loaded segments by segments in the online mode. So we should memory the wfst state of the previous segments. When the next segment is loaded, we can follow the wfst token states of previous. So the usual decoder can not be used and need online decoder.
from pytorch-kaldi.
mravanelli
commented on May 19, 2024
Yes, as outlined by @Rpersie the systems are different. In online ASR we
start the decoding while recording the signal itself and we thus don't have
access to the future.
We will deal with it the the future!
…On Tue, 26 Feb 2019 at 03:29, Rpersie ***@***.***> wrote:
As the offline cmvn is the mean and var of all frames，in the online mode
you can not get all the frames. If you just do the online-cmvn, this will
bring the mismatch between the training and test. As for decoding, the
feats are loaded segments by segments in the online mode. So we should
memory the wfst state of the previous segments. When the next segment is
loaded, we can follow the wfst token states of previous. So the usual
decoder can not be used and need online decoder.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#56 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AQGs1jy2bdZhlptXvjFd1C3c0vEXubNeks5vRPBngaJpZM4bPAmE>
.
from pytorch-kaldi.
Related Issues (20)
- How to setup parameters in "cfg/TIMIT_baselines/TIMIT_liGRU_fmllr.cfg"? HOT 1
- Do bidirectional layers share the input-to-hidden weights? HOT 2
- Can we resume training from the epoch we got interruption HOT 4
- input shape of nns HOT 3
- Question about the Dimension of wx.0.weight in my mlp model HOT 1
- The loss curve of train and dev is reasonable but why the Test Error keeps 53% or so? HOT 8
- Support for torch.nn.Transformer Class? HOT 1
- KaldiFatalError during decoding phase
- No WER stdout when decoding
- Does pytorch-kaldi support chain model training? HOT 1
- Word transcription of TIMIT dataset HOT 1
- No Decoding Output HOT 20
- How to train/decode on reverberant speech? HOT 1
- x-vector DNN model
- Unable to run forwarding step on test set
- Before switch to SpeechBrain, how to use trained model in pytorch
- Use final_architecture1.pkl for live test HOT 4
- err_te is 1
- using different features instead of FMLLR
- res.res
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pytorch-kaldi.