Comments (5)
ChrisCummins
commented on July 17, 2024
This doesn't appear to be an issue any more.
from programl.
Zacharias030
commented on July 17, 2024
It still was an issue yesterday afternoon. I spent my time yesterday on making the debbuger work by copying the runfiles symlinks into the tree and eventually that succeeded on davinci. (Not on local, bc. Of the connection refusal -which I haven’t had time to investigate further, but thanks for your comment there!)
I wonder what changed to make NaN dissappear...
I will confirm as well.
Am 15. Dez. 2019, 00:31 +0100 schrieb Chris Cummins <[email protected]>:
… Closed #37.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub, or unsubscribe.
from programl.
Zacharias030
commented on July 17, 2024
I still get this on devmap at least, even when setting lr=0.0.
Solving this will be my priority now.
from programl.
ChrisCummins
commented on July 17, 2024
Thanks that sounds good. There's two aspects to this:
- what influence this has on the model behavior
- making the logging backend accept
nanvalue
If loss affects #1, then that's the priority. If there's ever a legitimate case for loss being nan then, then we need to also fix #2, which should be super straightforward, loss=-1 if math.isnan(loss) else loss or equivalent
from programl.
Zacharias030
commented on July 17, 2024
Anyway, there’s never a reason to have NaN anywhere in our models and usually a single nan quickly propagates through the whole network and makes any and every parameter go NaN.
Am 16. Dez. 2019, 16:10 +0100 schrieb Chris Cummins <[email protected]>:
… Thanks that sounds good. There's two aspects to this:
1. what influence this has on the model behavior
2. making the logging backend accept nan value
If loss affects #1, then that's the priority. If there's ever a legitimate case for loss being nan then, then we need to also fix #2, which should be super straightforward, loss=-1 if math.isnan(loss) else loss or equivalent
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub, or unsubscribe.
from programl.
Related Issues (20)
- Relax grpcio version requirement
- Loss Function of ProGraML HOT 1
- Not able to use programl HOT 12
- Support for LLVM 14.0.0 HOT 4
- End-to-End Debug with LLVM, ProGraML & gdb HOT 1
- Features drop when using to_networkx() and resulting networkx graph is incompatible with torch_geometric from networkx HOT 2
- Demo for pretrained checkpoint HOT 1
- Graph visualization from my self-define .json/.gexf file HOT 5
- GraphCreationError when using libstdc++.so.6 without GLIBC_2.27, GLIBCXX_3.4.20, and GLIBCXX_3.4.21 HOT 1
- Reproduce ICML '21 experiments HOT 3
- Metadata difference between original LLVM file and produced Graph HOT 5
- Generating ProgramL graphs from partial code HOT 4
- How does ProGraML capture Loop optimization (loop unroll) information during graph generation? HOT 1
- Error due to DGLHeteroGraph imports HOT 2
- Data not present in pydot graph. HOT 1
- Missing GNN models HOT 1
- pip install HOT 2
- Add list of supported operating systems
- ProGraML package breaks with recent DGL api changes HOT 3
- How to train a GNN model? HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from programl.