Comments (1)
Hi,
Thank you for your message.
Let me start answering you by first commenting on the:
MAD-Twinnet assumes skip-filtering connection to produce masked output
Skip-filtering connections produce filtered output, i.e. the skip-filtering connections actualy apply a filter to a signal.
If I understand correct what you mean by:
Could you provide any relevant material that mask can be estimated by the function of mixture? (formula (8))
then the first work that actually did this is one of our previous work [1] (i.e. MaD v.0.1). After that, the work by [2] followed, then is our work in [3] (i.e. MaD v.1.0), and then is the MaD Twinnet [4]. If you (or anybody else) find more references, please reply to this thread :)
As for the last part:
Also, could skip-filtering connection can be valid for general speech enhancement which can include reverberation, channel distortion?
I do not know :) It might be good, it might not! Feel free to try it!
References
[1] S.-I. Mimilakis, K. Drossos, G. Schuller, and T. Virtanen, “A recurrent encoder-decoder approach with skip-filtering connections for monaural singing voice separation,” in 27th IEEE International Workshop on Machine Learning for Signal Processing (MLSP), Tokyo, Japan, Sep. 2017.
[2] A. Jansson, E. Humphrey, N. Montecchio, R. Bittner, A. Kumar, and T. Weyde, “Singing voice separation with deep U-Net convolutional networks,” in 18th International Society for Music Information Retrieval Conference, Suzhou, China, Oct. 2017.
[3] S.-I. Mimilakis, K. Drossos, J.-F. Santos, G. Schuller, T. Virtanen, and Y. Bengio, “Monaural singing voice separation with skip-filtering connections and recurrent inference of time-frequency mask,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, Canada, Apr. 2018.
[4] K. Drossos, S.-I. Mimilakis, D. Serdyuk, G. Schuller, T. Virtanen, and Y. Bengio, "MaD TwinNet: Masker-Denoiser Architecture with Twin Networks for Monaural Sound Source Separation," in IEEE World Congress on Computational Intelligence/International Joint Conference on Neural Networks (WCCI/IJCNN), Rio de Janeiro, Brazil, Jul. 2018.
from mad-twinnet.
Related Issues (15)
- Memory error when use use_me.py HOT 13
- Missing variable from model file HOT 8
- helper module is not working HOT 3
- about overlapping frames HOT 3
- Could not find a version that satisfies the requirement torch==0.4.1 HOT 1
- 'outputs/states/mad.pt' file not found error while using the use_me.py script HOT 3
- pre_train modules do not correspond to the code
- RuntimeError: invalid argument 1: empty Tensor at /pytorch/torch/lib/TH/generic/THTensorMath.c:3381
- output size not equal to input size HOT 3
- No module named helpers HOT 7
- Error When I run scripts/training.py HOT 17
- Unable to reproduce same error metrics as claimed in the paper HOT 8
- AttributeError: 'NoneType' object has no attribute 'to' when use use_me.py HOT 2
- in case of single background instrument HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mad-twinnet.