Question about CA44 results about t-rex HOT 4 CLOSED

Hi @wjn922
We are evaluating on train, val, and test sets. All datasets in this config are used for evaluation. The specific results can be found at here.

from t-rex.

Thanks for your quick response!

In my understanding, you adopt the CA44 train set for training. And then directly using the model to evaluate on CA44 val/test set, FSC-147 test set, FSCD-LVIS test set. Am I correct? I am curious why you also use the CA44 train set for evaluation?

And after checking the results, I found that the performance of GroundingDINO and BMNet+ is much better than that in the paper T-Rex. What's the reason?

Many thanks in advance.

from t-rex.

Sorry for the misunderstanding. I found that the Grounding DINO and FamNet results were results for a certain version of T-Rex. I've re-updated the results and they should be correct now. For CA-44 Benchmark, we only use it for evaluation (all train, val, and test sets will be used for evaluation) and we do not train on this benchmark.

from t-rex.

Thanks for your reply. Great works again!

from t-rex.