A framework for easy prototyping of distributed reinforcement learning algorithms
License: MIT License
There are many errors in the code
Hi,
When I'm running the run_apex_dqn.py example on my desktop there are no errors. However, on a server I'm having the following error:
2020-06-08 02:50:22,317 ERROR worker.py:1559 -- Possible unhandled error from worker: ray_worker (pid=20930, host=gra972)
File "/project/6005065/avrech/distributedRL/common/abstract/learner.py", line 84, in run
step_info, idxes, priorities = self.learning_step(replay_data)
File "/project/6005065/avrech/distributedRL/apex_dqn/dqn_learner.py", line 55, in learning_step
loss1.backward()
File "/project/6005065/avrech/venv/lib/python3.7/site-packages/torch/tensor.py", line 195, in backward
torch.autograd.backward(self, gradient, retain_graph, create_graph)
File "/project/6005065/avrech/venv/lib/python3.7/site-packages/torch/autograd/__init__.py", line 99, in backward
allow_unreachable=True) # allow_unreachable flag
RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn
What could be the reason for this inconsistency?
I am restricted to use torch 1.4.0 on the server, and this is the torch version I tested on my desktop.
Thanks
Avrech
I can run it now. Thanks!
Thanks for sharing your codes. But the current version making the running forever, I want to know when will you update your code to fix it? It may need different stop conditions for the run() of learner, worker and buff_relay?
Hello, under what license is this project released under ? I would like to study it to learn from it. Thank you.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. πππ
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google β€οΈ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.