How to limit number of threads spawned? about drq HOT 4 CLOSED

Try to launch this way:
OMP_NUM_THREADS=1 python ...

from drq.

Thanks, I tried this which indeed reduced the number of threads. However, the throughput is still poor when running multiple jobs on a single node. I'm guessing the jobs are just CPU-bound and more than 4 cores per GPU are needed.

from drq.

I think this could be because of MuJoCo rendering, as our algorithm does pretty much everything on GPU. Maybe it is worth looking into it.

from drq.

Thanks! I tried running the TF2 implementation of Dreamer, and it did not slow down when running multiple jobs on the same node which makes me suspect that it's not a MuJoCo issue. If the jobs aren't CPU bound for you, it might just be something with the node I'm using.

from drq.