Code for the Million Song Dataset, the dataset contains metadata and audio analysis for a million tracks, a collaboration between The Echo Nest and LabROSA. See website for details.
Home Page: http://labrosa.ee.columbia.edu/millionsong/
License: Other
Hello
I am trying to convert the .h5 files to CSV or json in order to do some data processing on them. For this, I am making use of the Python Source files.
After making changes to some of the outdated pytables code (for eg replacing openFile with open_file etc.), I am still getting errors like these:
group ``/metadata`` does not have a child named ``artist_terms_freq``
group ``/metadata`` does not have a child named ``artist_terms``
Is there a way to resolve them? Thanks
Hi. I am trying to use MSongsDB but it seems the link provided for 7digits API key is not working anymore. Any idea how to get this key?
The million song dataset website links to echonest for more details about the extracted features from the audio, but the echonest developers page has since gone down I believe.
Is there any information about the original FFT parameters used to compute the segments_timbre feature? What does a "segment" mean exactly? Which mel coefficients were used and which contributed to the principle components used?
Is this information lost?
Thank you!
I am attempting to build, from source, the C++ lib. I have just compiled the latest HDF5 1.8.8 lib, on my Ubuntu machine. Compiling these MSongDB C++ libs fails for me, though. There are a lot of undefined references.
I did have to modify the Makefile to link to my HDF5 lib includes. So, my Makefile looks like this:
# compiler
CC=g++
# options passed to the compiler
CFLAGS=-c -Wall -std=c++0x -O2
all: hdf5_getters.o hdf5_display.o
$(CC) -L/usr/local/hdf5/lib -lhdf5 -lhdf5_cpp hdf5_display.o hdf5_getters.o -o hdf5_display
hdf5_display.o:
$(CC) $(CFLAGS) -I/usr/local/hdf5/include -c hdf5_display.cc
hdf5_getters.o:
$(CC) $(CFLAGS) -I/usr/local/hdf5/include -c hdf5_getters.cc
clean:
rm -rf *.o hdf5_display
And the errors that I am receiving look like this:
λ ~/cpp-libs/hdf5-wrapper/ make
g++ -c -Wall -std=c++0x -O2 -I/usr/local/hdf5/include -c hdf5_getters.cc
g++ -c -Wall -std=c++0x -O2 -I/usr/local/hdf5/include -c hdf5_display.cc
g++ -L/usr/local/hdf5/lib -lhdf5 -lhdf5_cpp hdf5_display.o hdf5_getters.o -o hdf5_display
hdf5_getters.o: In function `HDF5Getters::HDF5Getters(char const*)':
hdf5_getters.cc:(.text+0x21): undefined reference to `H5::Group::Group()'
hdf5_getters.cc:(.text+0x29): undefined reference to `H5::Group::Group()'
hdf5_getters.cc:(.text+0x35): undefined reference to `H5::Group::Group()'
hdf5_getters.cc:(.text+0x5e): undefined reference to `H5check_version'
hdf5_getters.cc:(.text+0x73): undefined reference to `H5::FileAccPropList::DEFAULT'
hdf5_getters.cc:(.text+0x78): undefined reference to `H5::FileCreatPropList::DEFAULT'
hdf5_getters.cc:(.text+0x85): undefined reference to `H5::H5File::H5File(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, unsigned int, H5::FileCreatPropList const&, H5::FileAccPropList const&)'
hdf5_getters.cc:(.text+0xe7): undefined reference to `H5::CommonFG::openGroup(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const'
hdf5_getters.cc:(.text+0xf2): undefined reference to `H5::IdComponent::operator=(H5::IdComponent const&)'
hdf5_getters.cc:(.text+0x101): undefined reference to `H5::Group::~Group()'
hdf5_getters.cc:(.text+0x11a): undefined reference to `H5::CommonFG::openGroup(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const'
hdf5_getters.cc:(.text+0x127): undefined reference to `H5::IdComponent::operator=(H5::IdComponent const&)'
hdf5_getters.cc:(.text+0x138): undefined reference to `H5::Group::~Group()'
hdf5_getters.cc:(.text+0x151): undefined reference to `H5::CommonFG::openGroup(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const'
hdf5_getters.cc:(.text+0x15e): undefined reference to `H5::IdComponent::operator=(H5::IdComponent const&)'
hdf5_getters.cc:(.text+0x16f): undefined reference to `H5::Group::~Group()'
hdf5_getters.cc:(.text+0x290): undefined reference to `H5::Group::~Group()'
hdf5_getters.cc:(.text+0x2c6): undefined reference to `H5::Group::~Group()'
hdf5_getters.cc:(.text+0x2ce): undefined reference to `H5::Group::~Group()'
hdf5_getters.cc:(.text+0x2d6): undefined reference to `H5::Group::~Group()'
hdf5_getters.o:hdf5_getters.cc:(.text+0x2eb): more undefined references to `H5::Group::~Group()' follow
hdf5_getters.o: In function `HDF5Getters::get_member_float(H5::Group const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> >)':
hdf5_getters.cc:(.text+0x40d): undefined reference to `H5::CompType::CompType(unsigned long)'
hdf5_getters.cc:(.text+0x41c): undefined reference to `H5::PredType::NATIVE_FLOAT'
hdf5_getters.cc:(.text+0x423): undefined reference to `H5::CompType::insertMember(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, unsigned long, H5::DataType const&) const'
hdf5_getters.cc:(.text+0x436): undefined reference to `H5::CommonFG::openDataSet(char const*) const'
hdf5_getters.cc:(.text+0x43c): undefined reference to `H5::DataSpace::ALL'
hdf5_getters.cc:(.text+0x451): undefined reference to `H5::DSetMemXferPropList::DEFAULT'
hdf5_getters.cc:(.text+0x461): undefined reference to `H5::DataSet::read(void*, H5::DataType const&, H5::DataSpace const&, H5::DataSpace const&, H5::DSetMemXferPropList const&) const'
hdf5_getters.cc:(.text+0x477): undefined reference to `H5::DataSet::~DataSet()'
hdf5_getters.cc:(.text+0x481): undefined reference to `H5::CompType::~CompType()'
hdf5_getters.cc:(.text+0x4ce): undefined reference to `H5::DataSet::~DataSet()'
hdf5_getters.cc:(.text+0x4d8): undefined reference to `H5::CompType::~CompType()'
hdf5_getters.o: In function `HDF5Getters::get_member_int(H5::Group const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> >)':
hdf5_getters.cc:(.text+0x5bd): undefined reference to `H5::CompType::CompType(unsigned long)'
hdf5_getters.cc:(.text+0x5cc): undefined reference to `H5::PredType::NATIVE_INT'
hdf5_getters.cc:(.text+0x5d3): undefined reference to `H5::CompType::insertMember(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, unsigned long, H5::DataType const&) const'
hdf5_getters.cc:(.text+0x5e4): undefined reference to `H5::CommonFG::openDataSet(char const*) const'
hdf5_getters.cc:(.text+0x5ea): undefined reference to `H5::DataSpace::ALL'
hdf5_getters.cc:(.text+0x5fa): undefined reference to `H5::DSetMemXferPropList::DEFAULT'
hdf5_getters.cc:(.text+0x60d): undefined reference to `H5::DataSet::read(void*, H5::DataType const&, H5::DataSpace const&, H5::DataSpace const&, H5::DSetMemXferPropList const&) const'
hdf5_getters.cc:(.text+0x619): undefined reference to `H5::DataSet::~DataSet()'
hdf5_getters.cc:(.text+0x623): undefined reference to `H5::CompType::~CompType()'
hdf5_getters.cc:(.text+0x66a): undefined reference to `H5::DataSet::~DataSet()'
hdf5_getters.cc:(.text+0x674): undefined reference to `H5::CompType::~CompType()'
hdf5_getters.o: In function `HDF5Getters::~HDF5Getters()':
hdf5_getters.cc:(.text+0x3a2): undefined reference to `H5::Group::~Group()'
collect2: ld returned 1 exit status
make: *** [all] Error 1
Any ideas?
It seems that newer releases of pytables have adapted PEP8 naming conventions as mentioned here.
tables.openFile() should now be tables.open_file() on line 39 of hdf5_getters.py. Sorry if this is already known. I just came across it and wanted to point it out!
Should you decide to update it, there is a handy pytables tool that automatically takes care of these name changes.
I tried to get a url of a 30s preview from 7digital.com using this script officially provided by the authors. I do have a 7digital API ID, the generated request is like:
http://api.7digital.com/1.2/track/preview?redirect=false&trackid=8707738&oauth_consumer_key=my_7digital_id
but the script keeps failing when trying to process this url. I did try several other tracks but also failed.
here's the console output of "python get_preview_url.py -7digitalkey my_7digital_id TRAXLZU12903D05F94.h5"
Traceback (most recent call last):
File "get_preview_url.py", line 272, in
preview = get_preview_from_trackid(track_7digitalid)
File "get_preview_url.py", line 203, in get_preview_from_trackid
xmldoc = url_call(url)
File "get_preview_url.py", line 69, in url_call
stream = urllib2.urlopen(url)
File "/Users/junqideng/anaconda/lib/python2.7/urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "/Users/junqideng/anaconda/lib/python2.7/urllib2.py", line 435, in open
response = meth(req, response)
File "/Users/junqideng/anaconda/lib/python2.7/urllib2.py", line 548, in http_response
'http', request, response, code, msg, hdrs)
File "/Users/junqideng/anaconda/lib/python2.7/urllib2.py", line 473, in error
return self._call_chain(*args)
File "/Users/junqideng/anaconda/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/Users/junqideng/anaconda/lib/python2.7/urllib2.py", line 556, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 404: Not Found
Thanks for the fix!
All codes in /PythonSrc are written in python 2.x. Nowadays many people use python 3.x, and it's troublesome to run python 2.x code. It would be helpful if a python 3.x version of code is available. Thanks.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.