Code Monkey home page Code Monkey logo

glasgowrangers's Introduction

VocaPoint

This is Team Glasgow Rangers' submission to HackZurich2017 which made it to the finale.

What is it and what does it do?

Our web application was build using Flask. The user can upload their PDF presentation and use the app to present it. The app uses an offline speech-detection and classification library to listen for keywords that the user can associate with each slide. Whenever a keyword is detected, the web app jumps to the corresponding slide. The application interprets audio streams in real-time using PocketSpinx and works offline.

Set it up

You need to install a few libraries to get the website running on your computer. We assume that you have a working python (version 2) environment, including some command line tool and a package manager. The libraries required and some useful commands can be found in the file website/setup.txt.

Run it

To see the website locally, run

$ python2 website/run.py

from this folder, and open a webbrowser at the local link, shown in the response of the above command.

glasgowrangers's People

Stargazers

avatar

Watchers

avatar avatar avatar avatar

Forkers

sgmqs

glasgowrangers's Issues

Library "ghostscript" only working on linux

The library "ghostscript", used to convert pdf to png, is not working on windows or mac
One could either

  • find a different library
  • avoid conversion to png, find a way to nicely display pdf in webpage
  • force everyone to finally convert to linux :)

Audio flow not working correctly

The processing flow of the audio stream is not working correctly. Ideally, it should be

User clicks on "Present" tab:
-> Render first slide
-> Run script for keyword detection (until detected)

Keyword detected:
-> Render corresponding slide
-> Rerun script for keyword detection (until detected)

keyword recognition not working

The tool pocketsphynx does not correctly identify keywords on all systems. Why this is the case is not currently clear, one should identify if

  • the microphone is successfully accessed
  • the library can read the audio stream
  • the keyword list is successfully read

if the problem persists, we might have to look for a different library.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.