Clarification needed regarding num_workers about rl_a3c_pytorch HOT 2 CLOSED

Thank you for the kind words.

So you don't have the static number of threads on your computer or server that you are using to run this, so number threads would not be a limiting factor here. As this is using python to achieve true parallelism we must use multiprocessing not multithreading as multithreading is the spawning of new threads within in a process and each process for python is run by its own python interpreter and the GIL (global interpreter lock) inhibits true parallel execution of threads within in a process and instead are executed orderly.

The num_workers parameter is just dictating the number of training processes where a model is trained on the game and then shares its updates by updating a shared model between its each process.

hope that helps

from rl_a3c_pytorch.

Thank you for the clarification! Is this project accepting contributions? Would love to contribute if possible.

from rl_a3c_pytorch.