Reproducing validation results about clip_prefix_caption HOT 7 CLOSED

Hello, I am also going to try to train and test this model recently, but I am not very familiar with these evaluation indicators. Do you mainly rewrite the code when you are doing evaluation or refer to some external libraries?

from clip_prefix_caption.

Hi @rm-rf-me , we used COCO caption evaluation tool for our evaluation to get the above numbers

from clip_prefix_caption.

got it, thanks a lot !

from clip_prefix_caption.

Hi @JHLee0513,
We have not validated that the code reproduce the exact numbers, but we did publish the model weights so you could check your evaluation script.
Please also note we have used Karpathy et el. script and the evaluation code of Oscar.

Is it possible that a bug or slightly different hyperparameters were inserted when publishing the code.
Sorry for not able to provide a solution to this issue.

from clip_prefix_caption.

Hi @rmokady,
Thanks for the reply, I believe that's a good idea. It seems like there's only the pretrained model on resnet encoder, is there also one with ViT?

from clip_prefix_caption.

Sorry, at this point we are not planning to release additional models

from clip_prefix_caption.

Got it, thanks for the info!

from clip_prefix_caption.