Training Loss become nan when do the shakespeare experiment under distributed environment about fedml HOT 5 CLOSED

@iuserea It seems your non-IID version has lower accuracy. For this case, you need to turn your hyper-parameters. You can use grid search to find a better learning rate, batch size, local epoch, rounds. Normally, IID and non-IID should use totally different hypera-parameters.

from fedml.

@iuserea have you resolved your issue?

from fedml.

@chaoyanghe I can't thank you enough! After trying grid search and random search,the acc became 40%.

from fedml.

@iuserea sounds good. Can you get results reported from this paper: https://arxiv.org/pdf/2003.00295.pdf ?

from fedml.

@chaoyanghe it's possible to get results from this paper.I've read it before.But the acc there is about 57% which is more than 40% of mine.

from fedml.