Comments (4)
pls check sms_wsj_plus.py which is the latest dataset for jointly speech separation, denoising and dereverberation. The code you referred to is old and not used in SpatialNet.
from nbss.
thanks for your response!
i have another 2 questions regarding to the sms_wsj_plus dataset that the speech signal in this dataset is treated as babble noise source:
https://github.com/Audio-WestlakeU/NBSS/blob/e988a6ec845b6153910bbd106059a50b0b2c4a09/data_loaders/sms_wsj_plus.py#L95C9-L95C115
self.noises = list(set(original_sources)) # take the speech signal in this dataset as babble noise source
- as the babble noise is speech and the targets of the network is also speech, how can the model know which source are the targets, the babble or the other speech?
- as the babble noise is directional source, does the babble noise need to be convoluted with the rirs?
thanks!
from nbss.
- as the babble noise is speech and the targets of the network is also speech, how can the model know which source are the targets, the babble or the other speech?
The babble noise is diffuse, while the target speech signals are directional, that is the key clue for the model to learn to distinguish them.
- as the babble noise is directional source, does the babble noise need to be convoluted with the rirs?
The babble noise is diffuse not directional, so it doesn't need to be convolved with rirs. And we use the method implemented in https://github.com/Audio-WestlakeU/NBSS/blob/main/data_loaders/utils/diffuse_noise.py to make it diffuse.
from nbss.
thanks for your response!
do you think it is reasonable to use wham noise as babble noise in sms_wsj_plus dataset?
from nbss.
Related Issues (20)
- pytorchlightning version mismatched or missing some code HOT 12
- For adhoc configuration HOT 1
- NBSSCLI.py: error: 'Configuration check failed :: No action for destination key "trainer.num_processes" to check its value.' HOT 3
- using one real recordings to inference HOT 23
- How to use custom dataset with SpatialNet HOT 2
- Error in WHAMR! Training HOT 3
- How to train model for more than 2 speakers? HOT 4
- 模型训练完成后,推理报错 HOT 2
- 关于SpatialNet 参数量变大从而对性能提升的上限 HOT 20
- Unable to run training HOT 2
- Question about mamba edition. HOT 3
- OSpatialNet貌似出现过拟合的问题? HOT 3
- 如何生成训练数据? HOT 23
- Ask Help for OnlineSpatialNet Mamba Version Can't Work HOT 3
- Can I use shorter training and testing utterances? HOT 1
- License HOT 1
- GPU memory requirements HOT 4
- `state` and `share_qk` options HOT 2
- How to train SpatialNet using CHiME3/4 dataset HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nbss.