Very low mAP about squeezedet HOT 9 OPEN

@aswwqhome1993 If you could provide more details, it would be helpful.

• Did you re-train the model? If so, how many iterations did you train? Did you make any modifications to the model?
• If you used pretrained model, which one did you use?
• How did you split the train-val set?
• ...

from squeezedet.

I just use the pretrained model you proposed (model.ckpt-87000) and do not re-train the model.
I also use random_split_train_val.py to split the train-val set.

from squeezedet.

I can confirm these low results with the provided squeezeDet model. The squeezeDet+ model achieves a 0.821 mean average precision, but the squeezeDet model under performs. Perhaps an incorrect model was uploaded?

from squeezedet.

Seems that the model is somehow broken. I will train a new model and update it in next few days. Thanks.

from squeezedet.

@BichenWuUCB ,@aswwqhome1993, is this issue solved ?

from squeezedet.

@BichenWuUCB Hi, I also have similar question. Instead training on KITTI or VOC, I train it in my own dataset which have VOC structure. The loss decrease in the first 1000 step but then go flatten. I stop the training at step 7000 and test the model. All the result boxes have very low confidence, and they all lay at the corner of the images. Not sure why it will happen, would you give any suggestions about it?

from squeezedet.

@HoracceFeng Hi Feng! I'm now just doing the same thing as you did, apply squeezedet to VOC or VOC-like database. I made some changes to the codes and met exactly the same problems as yours -- loss fixed after hundreds of steps, very low confidence when running eval.py. So have you figured out how to solve those problems?

from squeezedet.

from squeezedet.

@HoracceFeng The thing is, if you are using your own customized dataset, you need to modify and set those anchors based on the distribution of your own dataset. Also, don't forget to recompile the make file in the src/dataset/kitti-eval. I did that and it works.

from squeezedet.