Light

tyranitar / noteworthy Goto Github PK

View Code? Open in Web Editor NEW

1.0 4.0 0.0 492 KB

Noteworthy is an app that automatically transcribes audio waves into sheet music.

License: MIT License

HTML 0.77% JavaScript 72.83% MATLAB 25.96% M 0.28% CSS 0.15%

noteworthy's Introduction

Noteworthy

Noteworthy is an app that automatically transcibes audio waves into sheet music. Currently, it has the following features:

A data pipeline that applies Fast Fourier Transform on audio waves to turn them into feature vectors.
A simple neural network that uses the feature vectors and ground truth from MIDI files to predict notes.
An Electron app that takes the output of the neural network to display sheet music.

noteworthy's People

Contributors

Stargazers

Watchers

noteworthy's Issues

Read MIDI input in Octave

Look into using this: http://kenschutte.com/midi
Ideally the end result of parsing the MIDI input will be an array of human-readable notes and chords.

Generate and load ML parameters through Octave

Create training examples directory
Train the algorithm using training files and output parameters to .mat file
Load parameters upon deploying Octave service

Recording view

This page should allow users to interact with their recordings via mic.

Index view

Develop multi-label classification algorithm

Read WAV input and perform FFT

Set up Electron to Octave communication

React informs Electron of selected .mp3 or .wav recording
Electron sends message to Octave service (file location)
Octave performs audioread and fft and outputs a .json file
Electron sends the output location to Electron
Electron parses the .json file and generates sheet music

Integrate sheet music generation into React

Use Paper component from Material UI.

Upload view

This is the page where you upload a audio file

Research ways to record MIDI and MP3 simultaneously

Currently looking at Audacity and Anvil Studio; want to start/stop recording both MIDI and MP3 simultaneously with a single click.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.