c3d_finetuning test error about c3d HOT 13 CLOSED

If the number of frames is not multiple of 16 might also be the cause of the problem, depending how you are extracting the features

from c3d.

@Michael-Guo Some of the clips in your testing set is failed to read. And the clip that was failed to read is belong to batch 30. However, because we shuffled the list, so we don't know which clips are wrong. Simple way is to change shuffle: false and track down clips that you missed, you an trace it out by adding some message show that which clips are missing, then either correct the frames/videos or remove those clips from the list file.

from c3d.

@Michael-Guo Did you solve the problem? How did you solve it?
I met the same problem when executing batch 1.
Thank you.

from c3d.

@dutran @Michael-Guo I found the error is due to an inconsistent typo in "test_01.lst":
/Hand"s"tandPushups/v_HandStandPushups_g01_c01/ should be modified as
/Hand"S"tandPushups/v_HandStandPushups_g01_c01/ to make it more consistent with the other directories' naming rule
Thank for your help. :D

from c3d.

@ycjlin I check my test_01.lst. Mine is correct. How did you find your error in your test_01.lst

from c3d.

@ycjlin @Michael-Guo there are several variants of UCF101 (the authors of UCF101 corrected the file names, action names a couple times: e.g. Pullup vs. PullUp, or HandStandPushups vs. HandstandPushups), thus there some inconsistency in the list.

from c3d.

@Michael-Guo I set shuffle as false in c3d_ucf101_finetuning_test.prototxt. Then I gradually removed some files in test_01.lst until there are no errors. Using the concept of "divide and conquer" to find the error files.
@dutran Thank for your detailed explanation. It helps a lot.

from c3d.

@dutran Is there some way to modify the source codes, so the program can show which file cannot be read. I set shuffle as false. I find the batch 9 which make errors. But all the paths are correct. I delete the bath 9. However, after several batches, the error occur again. I am very confused.

from c3d.

@ycjlin Could you please send you test file for me, there are one more errors in my file. I want to look your test file as a reference. Thank you! My e-mail address is [email protected]. Thanks a lot!

from c3d.

@dutran @dutran I set shuffle as false in c3d_ucf101_finetuning_test.prototxt. Then I manually find two terms leading to the error in test file.
They are
/ApplyLipstick/v_ApplyLipstick_g02_c01 113 1
BabyCrawling/v_BabyCrawling_g04_c01 113 3.
But I find the path in list is consistent with database's path. If I remove the two terms, the program can go down, but the same error will occur in the following batch.
Thus, I guess that frames in a clip are less than 16 may be the reason. The frames in the two clips are both less than 16.

from c3d.

@Michael-Guo you can un-comment line 127 (//LOG(ERROR) << "cannot read " << layer->file_list_[id];) in https://github.com/facebook/C3D/blob/master/src/caffe/layers/video_data_layer.cpp, to have the message out which clips are missing.

Yes, it needs 16 frames (by design of C3D architecture), but if you train you own architecture, this can be set differently.

from c3d.

@dutran If a clip has less than 16 frames, how can we deal with this situtation in train or test. Just remove the clip?

from c3d.

I wrote the following piece of code to get a validated test file. Briefly, it checks whether the last block used in each clip of the dataset has the 16 frames. It also prints the clips that have issues.
validate_dataset.py.zip

from c3d.