Comments (7)
Hi,
It doesn't seem to be happening to me but I'll try to let it run a little.
It's hard to debug, do you have a clue what could be causing this?
It is possible that it is due to too much overfitting so the loss becomes numerically unstable but it can also be something else.
Have you changed the configuration? A learning rate that is too large or too small (because of the decay?) can cause this too.
from muzero-general.
If I load the same network and continue training I get the same error almost immediately. By doing this I traced the nan values to
Line 444 in af199b8
observation
doesn't contain any nan's, but encoded_state
is filled with only nan. It looks to me like the network is broken somehow?
I used the default config while training. I can send you the model if that would help.
from muzero-general.
@guskal01
It would be great: [email protected]
Thanks
from muzero-general.
Sent. To reproduce, start muzero.py, choose tictactoe, load pretrained model, start training.
I also included the tfevents-files in case you want to see if something strange happened during training.
from muzero-general.
Hi,
Thanks
I based myself on this commit. I loaded the weights and I had no errors and the training continued normally for at least 1000 self played games.
I tested with Ubuntu and Mac, it seems to work fine ...
I also tried to set approximately the same self-play / train ratio, it worked well too.
Do you use the latest version of Ray and PyTorch?
I updated the normalization in the last commit, it doesn't change anything for me but maybe it will solve the error for you.
from muzero-general.
Thanks for the help, and sorry for the very late reply.
I haven't had time to let it run for a very long time, but so far I haven't had any problems with the latest commit. I'll send another comment if the problem returns.
from muzero-general.
Just left it running for a long time now without problem, so it seems to be fixed.
from muzero-general.
Related Issues (20)
- Question: Does muzero-general support 2 player games with simultaneous action selection? HOT 3
- TypeError: can't pickle function objects
- Only One Player: Can we use MuZero? HOT 2
- The model does not converge for breakout HOT 11
- Question about the perspective transformation of two players when calculating Q?
- Can't train using GPU? The torch version for this environment is '1.10.0cpu', that is, CPU one. HOT 2
- Question about the dimension of value and reward network
- Mean_value plot in Total_reward - Interpretation
- Without Selfplay, why 1 games on a running?? HOT 2
- Update gym package to gymnasium HOT 1
- Dirichlet noise added outside of training
- The difference between offical pseudo code and this repository about "num_unroll_steps"
- question about action encoded
- Breakout: ModuleNotFoundError shows gym[atari] instead of python-opencv HOT 1
- Muzero crashes when choosing spiel/backgammon
- MuZero choose the same action
- How can I use a pre-trained model? HOT 1
- What does the `replay_buffer.pkl` do? HOT 1
- cross play between models
- Chess and other non-trivial games HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from muzero-general.