Code Monkey home page Code Monkey logo

qspeech's Introduction

QSpeech

QSpeech: Low-Qubit Quantum Speech Application Toolkit

Accepted by the International Joint Conference on Neural Networks (IJCNN) 2022

Introduction

This repository is the official implementation of QSpeech: Low-Qubit Quantum Speech Application Toolkit.

It proposes:

  • The low-qubit variational quantum circuit (VQC).
  • A library for the rapid prototyping of hybrid quantum-classical neural networks in speech applications.
Low-qubit VQC QSpeech Framework

For the hybrid quantum-classical neural networks in speech applications, we implement the Quantum M5(QM5), Quantum Tacotron(QTacotron) and Quantum Transformer-TTS(QTransformer-TTS).

Requirements

  • Linux (Test on Ubuntu18.04)
  • Python3.6+ (Test on Python3.6.8)
  • PyTorch
  • PennyLane
  • Librosa (version 0.7.2)
  • Numba (version 0.48.0)

Basic framework

  • QCircuit: the variational quantum circuit(VQC) and low-qubit VQC.
  • QLayer: the qlstm, qgru, qattention, qconv.
  • QModels: the qm5, qtransformer, qtacotron.

Notes

The code of qlstm and qtransformer are based on these two projects as follow:

How to use

Download the datasets

  • LJSpeech1.1
  • SpeechCommandV0.02

QM5

  • cd ./Examples/QM5
  • Modify the config.py, like the path of dataset
  • python3 speech-command-recognition.py

QTacotron

  • cd ./Examples/QTacotron
  • Modify the hyperparams.py, like the path of dataset
  • python3 train.py --batch_size 2

QTransformer-TTS

  • cd ./Examples/QTransformerTTS
  • Modify the config.py, like the path of dataset
  • python3 train.py

Citation

If you find QSpeech useful in your research, please consider citing:

@inproceedings{hong2022qspeech,
  title={QSpeech: Low-Qubit Quantum Speech Application Toolkit},
  author={Hong, Zhenhou and Wang, Jianzong and Qu, Xiaoyang and Zhao, Chendong and Tao, Wei and Xiao, Jing},
  booktitle={2022 International Joint Conference on Neural Networks (IJCNN)},
  pages={1--8},
  year={2022},
  organization={IEEE}
}

qspeech's People

Contributors

zhenhouhong avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

qspeech's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.