Validation Accuracy on UNETR and Swin UNETR about research-contributions HOT 3 CLOSED

Hi @hanoonaR

Thanks for the comments. The validation accuracy reported in the repo denotes for a single fold and by splitting the publicly available training data. For the leaderboard however, following the approach by previous SOTA for both models, we have used an ensemble of 20 models and extra private training data which increases the number of samples to 80 volumes. This is described in section 4.3 of the UNETR paper.

I hope this addresses the concerns.

Best,

from research-contributions.

Similar issue in another dataset (similar to BTCV), these two models are even worse than 3dunet.

from research-contributions.

Hi @lbf4616

Thanks for the comment. Based on our experience for both models, each task requires careful tuning to achieve optimal performance. For instance, we note that choice of optimizer, which is AdamW in our case, the learning rate scheduler and number of epochs could play an important role to achieve the best performance.

Overall, in most MSD tasks and BTCV, our model consistently outperformed unet or nnunet, if carefully tuned.

Best,

from research-contributions.