Tiny ImageNet Training Configuration about robnets HOT 4 CLOSED

Try two things: 1. increase the batch size; 2. for the first 10-20 epochs, train the network on the clean dataset, then use PGD training.

from robnets.

Sorry, can it be more detailed? For example, how much is the batch size?

from robnets.

It depends on the model and the GPU memory you can access. All of the experiments in the paper are conducted by fulfilling 32 1080TI GPUs. e.g. for RobNet_large, the batch size is 512, and for RobNet_free, the batch size is 320. (The batch size here may be different if you use the model file in this repo, since before submitting the paper, we used the supernet with masks forming RobNet_large and RobNet_free to get performances on Tiny-Imagenet.)

from robnets.

Thank you.

from robnets.