Code Monkey home page Code Monkey logo

pepper-google-assistant's Introduction

pepper-google-assistant

The basic objective of this project was to enable Google Assistant on the Pepper Robot. Because of a lack of root access on the robot, we had to find alternative ways to make this work such as using the notorious PYNAOqi framework which provided no actual guarantee of working at all times.

We had also developed a simple front end to either follow the interaction between the robot and any other person and also to synthesize speech using several Text-to-Speech API's.

What we have achieved

  • Build a custom Google Assistant solution for the Pepper humanoid Robot.
  • Train a simple voice trigger command on which the Pepper robot will start listening when its name ("pepper") has been said.
  • Combine both these solutions in one solution.
  • Build a front end for both the Google Assistant solution and the Text-to-Speech functionality.

Notes

Please refer to the my bachelor thesis Teach Robots to speak: Text 2 Speech Solutions for Robotics for more details about this project.

pepper-google-assistant's People

Contributors

kenanekici avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

pepper-google-assistant's Issues

install

Greeting!
Is it possible for you to write a step-by-step Google Assistant installation guide for my Pepper robot, it would be awesome if you could, so I don't mess everything up(Just in case and so others can use such a piece of useful information)!
I am looking forward to hearing from you soon!
Best regards!

workaround for portaudio?

Do you know of a way to not need portaudio or to install it on the robot maybe?

If this was possible, we could run the assistant directly on the robot.

Problem running web server

When I run FLASK_APP=webserver.py flask run on my computer, I get this error:

 * Serving Flask app "webserver.py"
 * Environment: production
   WARNING: Do not use the development server in a production environment.
   Use a production WSGI server instead.
 * Debug mode: off
Usage: flask run [OPTIONS]

Error: While importing "pepper-google-assistant.webserver", an ImportError was raised:

Traceback (most recent call last):
  File "/home/spoody/Projects/pepper-google-assistant/env/lib/python3.7/site-packages/flask/cli.py", line 235, in locate_app
    __import__(module_name)
  File "/home/spoody/Projects/pepper-google-assistant/webserver.py", line 8, in <module>
    from naoqi import ALProxy
ModuleNotFoundError: No module named 'naoqi'

Speech Recognition and Synthesis - Customer Demo Proxy to Google Cloud APIs - How are you using/doing it?

Hello! I'd be interested in how you can perform the speech recognition for the bot.

I see you used the endpoint https://cxl-services.appspot.com/proxy?url=https%3A%2F%2Fspeech.googleapis.com%2Fv1p1beta1%2Fspeech%3Arecognize

How does this work? Is Google Cloud basically offering their features for free through this proxy?

I also found this proxy, and Googling the link lead me to this line in your file: https://github.com/kenanEkici/pepper-google-assistant/blob/master/webserver.py#L92

I found out that Google uses that proxy for a demo, but that demo requires the completion of a captcha, after which grants your IP to a ≈4h whitelist for using the proxy. Is this consistent with your results?

How are you doing this without completing captchas every 4 hours?

In addition, does this mean that we can create another proxy where there is a Selenium webscraping bot that uses a Buster-like technique to automatically complete the captcha every four hours (I can make that happen)? This means the IP of the proxy will always be whitelisted, so we can allow the entire world to synthesize text through the proxy, without paying for Google Cloud services.

Any contact would be greatly appreciated!

Steps

Hi,
Can you please write step-by-step instruction for this repository?

Message corrupt error

Hi,

I have the following issue when Pepper tries to play the response from google assistant. Do you know where it comes from or if I missed something ?

Many thanks !

Capture d’écran 2019-07-31 à 15 57 40

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.