Comments (4)
Curt-Park
commented on August 25, 2024
It would be great if you can share your idea with simple implementation.
This project is opened to everyone, and you can join anytime. :)
from rainbow-is-all-you-need.
Meta-YZ
commented on August 25, 2024
File "D:\Paper\double_tf\segment_tree.py", line 65, in setitem
self.tree[idx] = self.operation(self.tree[2 * idx], self.tree[2 * idx + 1])
ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()
Error: tcpip::Socket::recvAndCheck @ recv: peer shutdown
Quitting (on error).
Hi! That's a problem. Do you have any good suggestions?
from rainbow-is-all-you-need.
Curt-Park
commented on August 25, 2024
@Yuanzhuo-Liu
I think you imported a wrong module that has the same name as the intended one.
You can see segment_tree actually used on this repo has a different logic in line 65.
https://github.com/Curt-Park/rainbow-is-all-you-need/blob/master/segment_tree.py#L65
from rainbow-is-all-you-need.
Curt-Park
commented on August 25, 2024
Please reopen the issue if you want to discuss more.
from rainbow-is-all-you-need.
Related Issues (20)
- Google Drive ,Saving,Loading,Resuming Features. HOT 2
- input state-action pair into Rainbow DQN HOT 1
- Running on Atari Games HOT 2
- "indices" in the N-step ReplayBuffer undefined HOT 2
- Categorical DQN parameters for Acrobot HOT 1
- Update torch, numpy version HOT 1
- What your version of segment_tree
- 奇怪的是，rainbow的代码容易出现内存不足的问题 interrupted by signal 9: SIGKILL HOT 3
- Atari HOT 1
- bias_sigma initialization in noisy net HOT 2
- Save memory checkpoints HOT 5
- V_min and V_max - Rainbow DQN HOT 4
- does this work with mountaincar and other gym environments HOT 2
- Update frequency/method and warm-up period HOT 2
- clear momory during n_step_learning HOT 2
- AttributeError: module 'gym.wrappers' has no attribute 'Monitor' HOT 2
- Save/Load capabilities HOT 2
- Not handling time limits
- Test time action selection
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rainbow-is-all-you-need.