Comments (12)
No, 44.9 and 46.1 is testing on Sports1M, not UCF101.
But if you training from scratch from UCF101, you will get ~45% (clip accuracy), if you fine-tune the model (which was trained on Sports1M), you will get ~ 77-78% (clip accuracy).
In any case, you can use the model either provided by us (which is pre-trained on Sports1M) or the your own fine-tuned model (on your own data/task) to extract fc6 or prob to make prediction. prob is directly related to the task of the trained net where fc6 can be further train which in our paper using a linear SVM. Hope that helps.
from c3d.
@whjxnyzh this looks OK to me. Note that this is clip-based accuracy. If you want to make video-based accuracy. You can use feature extraction tool, to extract soft-max predictions (e.g. layer "prob" activations) and then aggregate these soft-max predictions to make video-based predictions (and so accuracy). A simple way to aggregate is to average the clip-based predictions to make video-based predictions.
from c3d.
@dutran Thank you very much, i will try it out.
from c3d.
@dutran , Great, "A simple way to aggregate is to average the clip-based predictions to make video-based predictions."
Now,the accuray is 0.8242135871
Thank you very much, this is my first experiment about video using deep learning method
from c3d.
@whjxnyzh @dutran How did you get these results?? When I run train_ucf101.sh it gives me around 45% accuracy!! But you get around 80% accuracy!!
@dutran also in the C3DUserGuide said that we get around 45% accuracy by running train_ucf101.sh!!
I'm confused about the accuracies!! In the paper we have 82% accuracy and here @whjxnyzh get's 82% accuracy but other guys (e.g. #42 ), me and C3DUserGuide reported ~45% accuracy!!
I really appreciate if you clarify this.
Best,
Mohammadreza
from c3d.
@mzolfaghari If you train from scratch, it is supposed to be around 45%. If you fine-tune, you can get higher accuracy 77-78% on clip-accuracy and 82-83% on video-accuracy
from c3d.
Hi again @dutran , I am confused again.... ;( I am reading your article Learning Spatiotemporal Features with 3D Convolutional Networks. In Table 2, C3D(fine-tuned from I380K pre-trained model), the accuracy for one clip hit@1 is 46.1%, not much higher than clip hit@1 of C3D (trained from scratch). Is there something I missed in your article or I misunderstood? Thank you in advance for your help.
from c3d.
There is nothing you missed. As I380K and Sports1M, fine-tuning can help but not making a big difference.
from c3d.
But you said "If you fine-tune, you can get higher accuracy 77-78% on clip-accuracy and 82-83% on video-accuracy". This is a quite big difference...
from c3d.
Yes, you fine-tune, then use fine-tuned model to extract prob, then make predictions. Does that make sense to you?
from c3d.
So this is what I think. Training from scratch on UCF101, then output directly from convnet, the clip-accuracy is around 44.9%. Fine-tuning on UCF101 from the pretrained model on I380K, the clip-accuracy is around 46.1%. But using fine-tuned model, with the extracted features and SVM, we could get 77-78% on clip-accuracy. Is this correct?
from c3d.
Thank you very much
from c3d.
Related Issues (20)
- Random crop is bad for this model? HOT 1
- Features are not being extracted for all the frames HOT 5
- static link error with anaconda HOT 1
- Couldn't found the result in the output folder HOT 1
- Make all fails at examples/mnist/convert_mnist_data.cpp HOT 2
- Error with no data at frame xx always appears while set sample_rate > 1
- Check Failed while training from scratch in 1.0 HOT 1
- using more gpu HOT 1
- ERROR : video_data_layer.cpp:252] Check failed: ReadImageSequenceToVolumeDatum
- File not found: conv3d_deepnetA_sport1m_iter_1900000 HOT 2
- [C3D v.1.0] Failed to execute: sh c3d_sport1m_feature_extraction_frm.sh HOT 4
- C3D Google Colab - Extract feature from raw video (mp4)
- Action similarity labeling - Similarity is NAN
- compilation error in C3D v1.0
- recipe for target '.build_release/src/caffe/proto/caffe.pb.o' failed,...Error while make in both C3D1.0 and 1.1
- GPU Configuration Details
- image_io.cpp:339] Could not open or find file HOT 1
- _make clean
- F0905 11:26:43.151420 12241 layer_factory.hpp:81] Check failed: registry.count(type) == 1 (0 vs. 1) Unknown layer type: Video_Data
- Have some error for running extract_C3D_feature.py in C3D-v1.0
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from c3d.