Comments (2)
Hi, thank you for your open source. I have some questions during reproduce the paper:
Typo in the code
./models/utt_fusion_model.py line18, 'lexical' should be 'visual'
./data/multimodal_dataset.py line70, 'proveee' should be 'process'Some small questions:
- why you choose BaseModel(ABC) as the parents class instead of nn.Module?
some convenient method like model.to(device) and model.parameters() cannot be used.
(In the code you used for-loop to apply these method to each layer, but it seems too complex)- In ./scripts, I did not find the file to train the baseline model with augmented data.
But there is a ./data_aug.sh which run the train_miss model with augmented data. Is this a miswritting?Thx!
Thanks for your attention! I'm one of the authors of this work.
For your question:
- Thanks! They are typo errors in the project, we will fix it soon.
- (1) BaseModel is the class which defines the training process, which includes loading a batch of data from dataloader, the forward caculation of the networks(which is nn.Module) as well as the backpropagation, maybe the name "Trainer" or "pipeline" could fit it better. Indeed, the name "Model" could be misleading, we will change the naming strategy of this code structure in the future work.
(2) The "scripts/data_aug.sh" is the training script of augmented baseline, "train_miss.py" is the scripts that evaluate model on missing modality data.
from mmin.
Thanks for your attention! I'm one of the authors of this work.
For your question:
- Thanks! They are typo errors in the project, we will fix it soon.
- (1) BaseModel is the class which defines the training process, which includes loading a batch of data from dataloader, the forward caculation of the networks(which is nn.Module) as well as the backpropagation, maybe the name "Trainer" or "pipeline" could fit it better. Indeed, the name "Model" could be misleading, we will change the naming strategy of this code structure in the future work.
(2) The "scripts/data_aug.sh" is the training script of augmented baseline, "train_miss.py" is the scripts that evaluate model on missing modality data.
Thank you for your kindly reply :)
As for the "scripts/data_aug.sh", the command in this file is "python train_miss.py" but as my understanding, the baseline training should be "python train_baseline.py" ?
Secondly, I have a question about the "eval" in file "train_miss.py". Line45 the result of "AVL" is evaluated. But in "data/multimodal_miss_dataset.py" line74 the related code is commented out and the list in line76 did not contain "AVL" also. Should this be fixed?
from mmin.
Related Issues (20)
- The code HOT 2
- Could you release the features for another dataset MSP? HOT 1
- Error occured while running 'mmin.sh'
- 请教关于实验结果 HOT 2
- CODE HOT 1
- MultimodalMissDataset中的问题 HOT 1
- train_miss.py代码好像有点问题,用测试集来选取最佳模型了 HOT 3
- Download IEMOCAP feature
- Download MSP-IMPROV features
- Visual Feature Extractor
- About param "share_weight"
- opt.pretrained_path这个字段,指的是哪一部分啊,运行显示none
- 预训练模型使用的数据集 HOT 21
- 比较的模型
- Pertinent Suggestion
- 'azz', 'zvz', 'zzl', 'avz', 'azl', 'zvl' HOT 1
- 可以提供划分交叉验证数据集的代码吗
- Data preprocess
- 训练时缺失率的问题
- Inquiry about Feature Extraction Setting
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mmin.