Android library for offline speech recognition base on Pocketsphinx engine. Add speech recognition feature into your Android app with easier implementations. RapidSphinx gives simple configuration and implementation for your app without dealing with Pocketsphinx assets and configuration. Just add it to your gradle!
- Build dictionary on the fly
- Build language model (Arpa File) on the fly
- Build JSGF Grammar on the fly
- Support PCM Recorder 16bits / mono little endian (wav file)
- Scoring system every single word (range 0.0 - 1.0)
- Detect unsupported words
- Rejecting Out-Of-Vocabulary (OOV) based on keyword spotting
- Speaker Adaptation (in progress)
- SIMPLE TO USE & FAST!
I have tried to speak in different word order:
Add to build.gradle :
compile 'com.icaksama.rapidsphinx:master:2.0.9'Add permissions to your Manifest:
<uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" />
<uses-permission android:name="android.permission.WRITE_EXTERNAL_STORAGE" />
<uses-permission android:name="android.permission.RECORD_AUDIO" />Add programs to your class/activity:
private void requestPermissions() {
if (ContextCompat.checkSelfPermission(this,
Manifest.permission.RECORD_AUDIO) != PackageManager.PERMISSION_GRANTED) {
ActivityCompat.requestPermissions(this,
new String[]{Manifest.permission.RECORD_AUDIO},
1);
}
}First, impletent the RapidSphinxListener in your class/activity :
public class MainActivity implements RapidSphinxListener {
private RapidSphinx rapidSphinx;
@Override
protected void onCreate(Bundle savedInstanceState) {
super.onCreate(savedInstanceState);
setContentView(R.layout.activity_main);
rapidSphinx = new RapidSphinx(this);
rapidSphinx.addListener(this);
}
}RapidSphinxListener have some methods must be @Override in your class/activity :
@Override
public void rapidSphinxDidStop(String reason, int code) {
if (code == 500) { // 500 code for error
System.out.println(reason);
} else if (code == 522) { // 522 code for timed out
System.out.println(reason);
} else if (code == 200) { // 200 code for finish speech
System.out.println(reason);
}
}
@Override
public void rapidSphinxFinalResult(String result, List<String> hypArr, List<Double> scores) {
System.out.println("Full Result : " + result);
// NOTE :
// [x] parameter "result" : Give final response with ??? values when word out-of-vocabulary.
// [x] parameter "hypArr" : Give final response in original words without ??? values.
// Get score from every single word. hypArr length equal with scores length
for (double score: scores) {
System.out.println(score);
}
// Get array word
for (String word: hypArr) {
System.out.println(word);
}
}
@Override
public void rapidSphinxPartialResult(String partialResult) {
System.out.println(partialResult);
}
@Override
public void rapidSphinxUnsupportedWords(List<String> words) {
String unsupportedWords = "";
for (String word: words) {
unsupportedWords += word + ", ";
}
System.out.println("Unsupported words : \n" + unsupportedWords);
}
@Override
public void rapidSphinxDidSpeechDetected() {
System.out.println("Speech detected!");
}You need to prepare speech recognition before use that. You can add new parameters in rapidPreExecute to increase accuracy or performance.
rapidSphinx.prepareRapidSphinx(new RapidPreparationListener() {
@Override
public void rapidPreExecute(Config config) {
// Add your config here:
rapidSphinx.setSilentToDetect(2000);
config.setString("-parameter", "value");
}
@Override
public void rapidPostExecute(boolean isSuccess) {
if (isSuccess) {
System.out.println("Preparation was done!");
}
}
});You can update the vocabulary with language model or JSGF Grammar on the fly. Make sure to remove the punctuation before update vocabulary/grammar.
// Update vocabulary with language model from single string
rapidSphinx.updateVocabulary("YOUR TEXT HERE!",
new String[]{"KEYWORD SPOTTING!", ...}, new RapidCompletionListener() {
@Override
public void rapidCompletedProcess() {
System.out.println("Vocabulary updated!");
}
});
// Update vocabulary with language model from array string
rapidSphinx.updateVocabulary(new String[]{"TEXT1!", "TEXT2!", ...},
new String[]{"KEYWORD SPOTTING!", ...}, new RapidCompletionListener() {
@Override
public void rapidCompletedProcess() {
System.out.println("Vocabulary updated!");
}
});
// Update vocabulary with JSGF Grammar from string
rapidSphinx.updateGrammar("YOUR TEXT HERE!",
new String[]{"KEYWORD SPOTTING!", ...}, new RapidCompletionListener() {
@Override
public void rapidCompletedProcess() {
System.out.println("Vocabulary updated!");
}
});// Set the Timeout in miliseconds
rapidSphinx.startRapidSphinx(10000);Make sure play audio record after speech recognizer is done.
rapidSphinx.getRapidRecorder().play(new RapidCompletionListener() {
@Override
public void rapidCompletedProcess() {
System.out.println("Audio finish!");
}
});Copyright (c) 2017 Saiful Irham Wicaksana
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent