Comments (6)
I am missing an option to have only a single note at a time.
I could imagine that the results might be better when the model knows that there is no polyphony, e.g. for human vocals of a single person.
from basic-pitch.
Hey @kasravi ! We do support human voice - (check out our about page) - but not every recording will work perfectly out of the box. On the website, you can try clicking on the MIDI adjustments menu below the transcription, which you can use to get a better transcription. For a quick demo of how the sliders work, you can see this demo here.
from basic-pitch.
Hey @rabitt , thanks for the reply. I intentionally used a sound that is relatively easy to detect pitches just by analyzing its FFT. From your reply, I understand that for each transcription you need to fine-tune the result manually. So this model is not meant to be used in an unsupervised environment?
from basic-pitch.
I have also found that Basic Pitch is great at detecting piano notes – played alone or simultaneously – but not as accurate for human voice (humming or whistling into a microphone). It seems to throw in unexpected staccato notes and high notes that weren't sung. I would love for this to be improved! I like the suggestion above of a non-polyphonic setting that maybe could improve accuracy for the use case of humming a tune. Maybe a setting to reduce pitch bend detection (round to the nearest note more aggressively) would also help.
from basic-pitch.
In case you are interested in pitch detection of human voice only:
The paper on Basic Pitch by Spotify is interesting and provides good pointers towards other automatic music transcription (AMT) systems.
From the conclusion:
NMP (i.e. the model behind basic pitch) achieves state-of-the-art results on GuitarSet. It however did not outperform the instrument-specific models for piano and vocals.
The vocals comparison was done with Vocano.
Vocano [9] is a monophonic vocal transcription method which first performs vocal source separation, then applies a pre-trained pitch extractor followed by a note segmentation neural network, trained on solo vocal data.
[9] J.-Y. Hsu and L. Su, “VOCANO: A note transcription frame-work for singing voice in polyphonic music,” in Proc. ISMIR, 2021
The VOCANO paper used Patch-CNN for pitch detection.
from basic-pitch.
In case you are interested in pitch detection of human voice only:
CREPE is another "monophonic pitch tracker".
A comparison of Basic Pitch, CREPE and others with respect to human voice pitch detection would be nice ( see also #45 )
from basic-pitch.
Related Issues (20)
- Программа завершает работу
- Can't detect vocals? HOT 4
- Crash when evaluating a particular recording HOT 14
- Question: would basic-pitch be capable of being adapted to work on realtime audio input from a mobile device mic? HOT 2
- Transition from setup.py to pyproject.toml HOT 3
- Can I use a converted tensorflow-lite model with basic-pitch? Do I need to adapt the basic_pitch_predict-function in some way? HOT 7
- Piano roll, web demo, tweak nice to have HOT 5
- 'add_slot' failing in Windows 11 installation HOT 7
- LLVM error HOT 1
- Looking forward to suggestions to improve output MIDI quality
- [Bug] AttributeError: module 'scipy.signal' has no attribute 'gaussian' HOT 2
- TypeError: predict() missing 1 required positional argument: 'model_or_model_path' HOT 3
- Review HOT 1
- Why are the running results of my python script and the online demo different? HOT 5
- Demo stalls at download
- Notes in MIDI output are different in python program compared to the demo website HOT 3
- Interpreting results with TensorFlow-lite HOT 2
- cant produce wav and csv on cli
- nice to have multi instruments supported
- Question regarding evaluation HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from basic-pitch.