Comments (5)
This is awesome great job! I'm actually currently working on training MIDI decoders in a more end-2-end fashion that should help a lot with all the artifacts. I'll let you know how it goes.
from ddsp.
This is the actually subject of my master thesis. I've posted some audio examples on this website (still under construction) . In short, I trained a separate model to predict pitch and loudness from estimated midi like @jesseengel mentions above. I then fed the predicted pitch and loudness features into a pretrained ddsp autoencoder. There is lots of room for improvement in my implementation but the overall method seems very promising.
from ddsp.
It should work to some degree. True instrument pitch often has small variations over time, not to mention bends and slides and what not. So it will make sound, but it might sound a bit synthetic. We am currently working on some models that learn to predict true pitch variations from a MIDI signal.
from ddsp.
Sounds great!
I think it's even possible to deal with polyphonic sounds if the encoder doesn't rely on extracting pitch from wav.
I'll try it out too. Thank you!
from ddsp.
Thank you! I'm looking forward to see what you come up with!
from ddsp.
Related Issues (20)
- OnlineF0PowerPreprocessor cannot function with compute_power = False.
- No module crepe
- AttributeError: module 'hmmlearn.hmm' has no attribute 'CategoricalHMM'
- AttributeError: module 'hmmlearn.hmm' has no attribute 'CategoricalHMM'
- AttributeError: module 'hmmlearn.hmm' has no attribute 'CategoricalHMM'
- AttributeError: module 'collections' has no attribute 'Iterable'
- python environment Mac M1 HOT 1
- train_autoencoder.ipynb error I got HOT 1
- ImportError: cannot import name 'dtensor_api' from 'keras.dtensor' HOT 5
- vst notebook
- error when training !
- pip is repeatedly installing various versions of same packages HOT 9
- Question About Midi Autoencoder
- Failed building wheel for llvmlite, Could not build wheels for numba, llvmlite, which is required to install pyproject.toml-based projects HOT 1
- timbre_transfer.ipynb is broken on Colab
- train_autoencoder.ipynb is broken on Colab
- Installation Guide HOT 1
- pitch_detection.ipynb is broken in Colab
- VST3 file format no detected not working with fl studio
- Training Script is not starting
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ddsp.