MT3 is a multi-instrument automatic music transcription model that uses the T5X framework.

This is not an officially supported Google product.

Use our colab notebook to transcribe audio files of your choosing. You can use a pretrained checkpoint from

a) the piano transcription model described in our ISMIR 2021 paper

b) the multi-instrument transcription model described in our ICLR 2022 paper.

c) the pretrained (on a large dataset of monophonic mixes) model from our ISMIR 2022 paper.

For now, we do not (easily) support training. If you like, you can try to follow the T5X training instructions and use one of the tasks defined in tasks.py.