Code Monkey home page Code Monkey logo

gator's Introduction

SYSTEM REQUIREMENTS

The setup was tested only for Windows 10. If you are using some other system you are on your own.
Supported browsers:

  • Chrome (Chrome has a strict policy regarding voice output. To enable TTS feature click left mouse btn once the website is loaded)
  • Edge

HOW TO RUN EXPERIMENT

  1. Follow SETUP LEAP MOTION
  2. Open Edge / Chrome (As of writting this doc (01-06-2021) Edge has way nicer TTS voice)
  3. Go to https://kind-plant-0d14acb03.azurestaticapps.net/
  4. Accept permissions to use microphone
  5. (Chrome only - click left mouse button)
  6. Test by saying start

Additional notes:
For better speach recognition use headphones

Gestures and Voice Commands

(v - voice command, g - gesture)

DEFAULT context:

v: select <phrase> - select phrase in text, stop reading, switch to SELECTED context
v: stop - stop reading
v: start / repeat - jump to the beginning of the current sentence (or jump to the previous sentence if cursor is at the beginning of sentence)
v: restart - jump to the beginning of the text
v: undo - undo the last change
g: wave in - jump to the beginning of the current sentence (or jump to the previous sentence if cursor is at the beginning of sentence)
g: stop - stop reading
g: swipe_left - undo the last change

SELECTED context:

v: stop - unselect the prase, switch to  DEFAULT context, resume reading
v: delete - delete selected phrase, switch to  DEFAULT context, resume reading
v: replace - switch to REPLACE context
v: insert before / before - switch to INSERT_BEFORE context
v: insert after / after - switch to INSERT_AFTER context
g: fist_and_throw_away - delete selected phrase, switch to  DEFAULT   context, resume reading
g: hand_upward - switch to REPLACE context
g: index_finger_left - switch to INSERT_BEFORE context
g: index_finger_right - switch to INSERT_AFTER context

INSERT BEFORE context:

v: stop - unselect the prase, switch to  DEFAULT context, resume reading
v: <phrase> - insert the phrase before the previously selected text, switch to DEFAULT context, resume reading

INSERT AFTER context:

v: stop - unselect the prase, switch to  DEFAULT context, resume reading
v: <phrase> - insert the phrase after the previously selected text, switch to DEFAULT context, resume reading

REPLACE context:

v: stop - unselect the prase, switch to  DEFAULT context, resume reading
v: <phrase> - replace the previously selected text with the new prase, switch to DEFAULT context, resume reading

SETUP LEAP MOTION

  1. Download Leap Motion Developer Kit - ORION 3.2.1 (it will require registartion) https://developer.leapmotion.com/releases/leap-motion-orion-321-39frn-3b659
  2. Connect Leap Motion to your laptop
  3. Open Leap Motion Controller Panel
  4. Test your connection in Visualizer (right click Leap Motion Controller in taskbar > Visualizer...)
  5. Turn on Allow Web Apps (right click Leap Motion Controller in taskbar > Settings...)

SETUP DEV ENV

  1. Install node.js (https://nodejs.org/en/download/)
  2. Install dependencies (npm install inside project's root folder)
  3. Start (npm start)
  4. In your browser (Chrome / Edge) open http://localhost:3000/

Dev - useful links

Leap Motion API reference:
https://developer-archive.leapmotion.com/documentation/javascript/api/Leap.Hand.html

DEPLOY TO WEBSITE

Contact:
Patryk Pomykalski
[email protected]

gator's People

Contributors

salvvador avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.