Multi gpu trainin about deepxi HOT 4 CLOSED

Hi, yes, tf2 is much better 👍.

Try, using GPU “0,1” with the arguments of run.sh if you want to use your first 2 gpus for example. I will have to verify this when i get time. Please message me the result.
Hope this helps.

from deepxi.

Thanks, Ill give it a go and let you know.

By the way, did you try larger batch sizes?
16 can also run with 1 gpu (12GB).

from deepxi.

I have not tried it. I would be interested to know how big the difference is.

from deepxi.

Multi GPU training doesn't work as it is. Keras distributed training should be not so tricky to implement. I will give it a try.
Also, I ran a small training with mbatch size =12 and it doesn't seem to degrade the training process.

from deepxi.