anita-hu / msaf Goto Github PK
View Code? Open in Web Editor NEWOffical implementation of paper "MSAF: Multimodal Split Attention Fusion"
License: MIT License
Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"
License: MIT License
CMU-MultimodalSDK @ fd18d71 is error
When i run "ravdess",the error is "Expected object of scalar type Double but got scalar type Float for argument #3 'mat1' in call to th_addmm"
Hello.
There are 2 optimizers in the training phase, and it seems to learn the pose stream and apperance stream alternately.
Is there a reason why you didn't learn to cross-entropy loss using only one optimizer after combining the results of the pose stream and appearance stream?
Thank you for always.
With this address,I have the problem:
Traceback (most recent call last):
File "dataset_prep.py", line 130, in
dataset = md.mmdataset(recipe)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/dataset/dataset.py", line 28, in init
self.computational_sequences[entry]=computational_sequence(address,destination)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/computational_sequence/computational_sequence.py", line 32, in init
h5handle,data,metadata=self.initialize(resource,destination)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/computational_sequence/computational_sequence.py", line 92, in initialize
return readCSD(self.mainFile)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/computational_sequence/file_ops.py", line 14, in readCSD
log.error("%s file not found, please check the path ..."%resource,error=True)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/log/log.py", line 18, in error
action("%s%s"%(msgstart,msgstring))
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/log/log.py", line 17, in
action,msgstart=(lambda x:( for _ in ()).throw(errorType(x)),": ") if error else (lambda x:sys.stdout.write(str(x)+'\n'),bcolors.WARNING+bcolors.BOLD+": "+bcolors.ENDC)
File "/root/autodl-tmp/MSAF-master/cmu_mosei/mmsdk/mmdatasdk/log/log.py", line 17, in
action,msgstart=(lambda x:( for _ in ()).throw(errorType(x)),": ") if error else (lambda x:sys.stdout.write(str(x)+'\n'),bcolors.WARNING+bcolors.BOLD+": "+bcolors.ENDC)
RuntimeError: : ./CMU_MOSEI/csd/CMU_MOSEI_VisualFacet42.csd file not found, please check the path ...
CMU_MOSEI not run.error:ModuleNotFoundError: No module named ‘mmsdk‘
Hello, can you give me a copy of the complete code of Resnext,thank you
Hi. Thank you so much for providing useful code.
When I tested NTU-RGBD datset through the command provided
'python main_msaf.py --datadir <path/to/NTU>
--checkpointdir checkpoints
--test_cp msaf_ntu_epoch12_92.24.checkpoint
--no_bad_skel'
, the performance was slightly different and 91.38 instead of 92.24.
Am I missing something? Thank you.
Hi. Thanks for sharing your work.
May I ask how you got the i3d_32frames_85.63.checkpoint?
When I downloaded i3d checkpoint pre-trained on imagenet/kinetics from https://github.com/rimchang/kinetics-i3d-Pytorch/tree/master/data/pytorch_checkpoints and fine-tuned the network on NTU DB, the accuracy was about 82.56.
And also when I downloaed i3d_32frames_85.63.checkpoint from your repo and fine-tuned the I3D network on NTU, the accuracy wen up to 88.41.
Thank you.
Hello, can the code in Figure 3 in the paper be published? I want to see a section of that code. Thank you
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.