Comments (3)
^upvote. -- I'm also not sure how this is working.
I played around with explain_nodes_gnn_stats
and dataset=syn1
(the house motifs datasets). Manually tried explaining nodes that were not included in range(400,700,5)
, and received errors. IIUC, evaluation is only being done using a specific house node only in red. Haven't looked at other datasets yet. Bit curious why this specific house node was selected, and why other house-nodes were not also included in the evaluation.
Any clarifications would be appreciated as well!
from gnn-model-explainer.
Hi,
Like you, I was trying to replicate the results in the paper.
For syn1 and syn2 evaluating the set of nodes in range(400,700,5) almost matches the AUCs provided.
For syn4, looking into make_pred_real(self, adj, start)
the range that matches the proposed mask nodes should be range(511, 871, 6)
. This refers to the node "starting" the cycle from the binary tree graph.
Hoewer I could not match the performances cited in the paper. I got only an AUC of 0.61 instead of the declared 0.948.
Any clarifications on the evaluation procedure would be helpful.
from gnn-model-explainer.
Hi,
Like you, I was trying to replicate the results in the paper.
For syn1 and syn2 evaluating the set of nodes in range(400,700,5) almost matches the AUCs provided.For syn4, looking into
make_pred_real(self, adj, start)
the range that matches the proposed mask nodes should berange(511, 871, 6)
. This refers to the node "starting" the cycle from the binary tree graph.Hoewer I could not match the performances cited in the paper. I got only an AUC of 0.61 instead of the declared 0.948.
Any clarifications on the evaluation procedure would be helpful.
What about the syn5? The source code did not provide make_pred_real
on syn5. And I find bug when I am trying to reproduce the results on syn4 like this:
Saved adjacency matrix to masked_adj_syn4_base_h20_o20_explainnode_idx_695graph_idx_-1.npy Traceback (most recent call last): File "/home/wrj/anaconda3/envs/ge/lib/python3.7/runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "/home/wrj/anaconda3/envs/ge/lib/python3.7/runpy.py", line 85, in _run_code exec(code, run_globals) File "/home/wrj/wtl/gnn-model-explainer-master/explainer_main.py", line 317, in <module> main() File "/home/wrj/wtl/gnn-model-explainer-master/explainer_main.py", line 312, in main range(400, 700, 5), prog_args File "/home/wrj/wtl/gnn-model-explainer-master/explainer/explain.py", line 323, in explain_nodes_gnn_stats pred, real = self.make_pred_real(masked_adjs[i], new_idx) File "/home/wrj/wtl/gnn-model-explainer-master/explainer/explain.py", line 585, in make_pred_real if real[start + 1][start + 2] > 0: IndexError: index 6 is out of bounds for axis 0 with size 6
from gnn-model-explainer.
Related Issues (20)
- Broken link to Observable in README.md
- The requirements.txt should be changed to make Installation work. HOT 1
- Where is the dataset and what kind of dataset am I supposed to use inorder to train? HOT 1
- While training on Tox21 data: "NameError: name 'io_utils' is not defined" HOT 1
- node_idx_new = sum(neighbors_adj_row[:node_idx])--is it possible the way that node_idx_new is generated may lead to duplicate index?
- Question on Explainer Visualization
- Question about link prediction HOT 3
- Question about run bmname=MUTA
- Generating different explanations' subgraphs from the same trained model by using PyG GNNExplainer HOT 1
- Generating Explanations for REDDIT-BINARY and Mutag dataset HOT 7
- Explain Graph Nets models
- Pytorch Geometric training for synthetic data HOT 1
- Frozen Synthetic Dataset
- Accuracy HOT 1
- Reproduction of multi-instance explanations and prototypes
- Doubt: GNNExplainer on Deep GCNN on Graph Classification Tasks HOT 2
- Use this model explain the graph-level GNN model? HOT 1
- Apply to hetero GNN?
- Observable notebook does not exist
- Question about the loss
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gnn-model-explainer.