- multi-worker, multi-GPU (blind cpu):
bash run_multiworker.sh 0 <addr> 0 1 <model name> <dataset name> 320 <batch size on single GPU>
- evaluation:
bash eval.sh
xcmyz / bert-race Goto Github PK
View Code? Open in Web Editor NEWBERT/ALBERT based model for RACE dataset, support multi-worker, multi-GPU, FP16 and bind CPU.