Leap Sign is working towards providing individuals who cannot speak with the means to communicate in an efficient, cost-effective manner.
- Uses the Leap Motion Sensor to identify the five fingers on a hand.
- Creates vectors for each finger and returns the extention of each finger as a value.
- Takes the vector values and compares it to our inputed requirements for various letters.
- Determines which letter has been signed and sends the word to "LeapSign.java"
- Imports various requirements (Color, File, JPanel, etc.)
- Recieves the letter from "LetterChooser.java" and appends it to a word.
- Performs predictive analysis using the the current word based on a dictionary.
- When a space has been signed, the word is analyzed and the program determines if a weather module is needed.
- While recieving each letter, it is sending each letter and three possible predictions to the "Leap Sign Interface" using Firebase
- Recieves each letter and three predictions from "LeapSign.java" through FireBase and displays each letter with each predicted word.
- Allows for the word to be autocompleted when a predicted word is chosen and relays back the information to "LeapSign.java".
- Displays the weather module if the word "weather" has been signed.