anita-hu / msaf Goto Github PK

CMU-MultimodalSDK @ fd18d71 is error

When i run "ravdess",the error is "Expected object of scalar type Double but got scalar type Float for argument #3 'mat1' in call to th_addmm"

Hello.
There are 2 optimizers in the training phase, and it seems to learn the pose stream and apperance stream alternately.
Is there a reason why you didn't learn to cross-entropy loss using only one optimizer after combining the results of the pose stream and appearance stream?
Thank you for always.

With this address,I have the problem:
Traceback (most recent call last):
File "dataset_prep.py", line 130, in
dataset = md.mmdataset(recipe)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/dataset/dataset.py", line 28, in init
self.computational_sequences[entry]=computational_sequence(address,destination)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/computational_sequence/computational_sequence.py", line 32, in init
h5handle,data,metadata=self.initialize(resource,destination)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/computational_sequence/computational_sequence.py", line 92, in initialize
return readCSD(self.mainFile)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/computational_sequence/file_ops.py", line 14, in readCSD
log.error("%s file not found, please check the path ..."%resource,error=True)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/log/log.py", line 18, in error
action("%s%s"%(msgstart,msgstring))
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/log/log.py", line 17, in
action,msgstart=(lambda x:( for _ in ()).throw(errorType(x)),": ") if error else (lambda x:sys.stdout.write(str(x)+'\n'),bcolors.WARNING+bcolors.BOLD+": "+bcolors.ENDC)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/log/log.py", line 17, in
action,msgstart=(lambda x:( for _ in ()).throw(errorType(x)),": ") if error else (lambda x:sys.stdout.write(str(x)+'\n'),bcolors.WARNING+bcolors.BOLD+": "+bcolors.ENDC)
RuntimeError: : ./CMU_MOSEI/csd/CMU_MOSEI_VisualFacet42.csd file not found, please check the path ...

CMU_MOSEI not run.error：ModuleNotFoundError: No module named ‘mmsdk‘

Hello, can you give me a copy of the complete code of Resnext，thank you

Hi. Thank you so much for providing useful code.

When I tested NTU-RGBD datset through the command provided
'python main_msaf.py --datadir <path/to/NTU>
--checkpointdir checkpoints
--test_cp msaf_ntu_epoch12_92.24.checkpoint
--no_bad_skel'

, the performance was slightly different and 91.38 instead of 92.24.
Am I missing something? Thank you.

Hi. Thanks for sharing your work.
May I ask how you got the i3d_32frames_85.63.checkpoint?

When I downloaded i3d checkpoint pre-trained on imagenet/kinetics from https://github.com/rimchang/kinetics-i3d-Pytorch/tree/master/data/pytorch_checkpoints and fine-tuned the network on NTU DB, the accuracy was about 82.56.

And also when I downloaed i3d_32frames_85.63.checkpoint from your repo and fine-tuned the I3D network on NTU, the accuracy wen up to 88.41.

Thank you.

Hello, can the code in Figure 3 in the paper be published? I want to see a section of that code. Thank you