Code Monkey home page Code Monkey logo

respeaker_for_raspberrypi's Introduction

ReSpeaker for Raspberry Pi

The repository contains some examples to use ReSpeaker series mic arrays on Raspberry Pi.

The examples are included in the custom image with pre-installed seeed-voicecard, snowboy, voice-engine and etc. You can flash the custom image to get started easily.

Hardware

ReSpeaker 2 Mic Hat, ReSpeaker 4 Mic Array or ReSpeaker 6 Mic Array (they are all pi hats)

Software

  • snowboy for KWS (Keyword Search / Keyword Spotting)
  • webrtc audio processing for NS (Noise Suppression)
  • speexdsp for AEC (Acoustic Echo Cancellation)
  • GCC-PHAT for DOA (Direction Of Arrial)
  • avs for alexa voice service
  • voice-engine for connecting all the elements together
pip install webrtc-audio-processing speexdsp voice-engine avs

and go to kitt-ai/snowboy to install snowboy.

Files


├── 2mic                               # ReSpeaker 2 Mic Hat
│   └── ns_kws_doa_alexa.py                hands-free alexa with NS, KWS and DOA (0 ~ 180 degree)
├── 4mic                               # ReSpeaker 4 Mic Array
│   ├── kws_doa.py                         KWS and then DOA
│   ├── ns_kws_doa_alexa.py                hands-free alexa with NS, KWS and DOA (0 ~ 360 degree)
│   └── ns_kws_doa.py
├── 6mic                               # ReSpeaker 6 Mic Array
│   ├── aec_ns_kws_doa_alexa.py            hands-free alexa with AEC, NS, KWS and DOA (0 ~ 360 degree)
│   ├── aec_ns_kws_doa.py                  has 2 loopback channels for AEC
│   └── kws_doa.py
├── ns_kws_alexa.py
├── ns_kws.py
└── ns_vs_raw.py                       Compare KWS between raw audio and audio with NS

respeaker_for_raspberrypi's People

Contributors

xiongyihui avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

respeaker_for_raspberrypi's Issues

Error when only trying to link aec ns doa

I can't seem to get for the respeaker 6 working without using kws (snowboy).
When using the library on the rpi and snowboy everythign works but is inaccurate in terms of noisy direction prediction.
I only want to polling pipeline: src -> ec -> ns and link src -> doa but can't seem to get it working

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.