mengliu1998 / deepergnn Goto Github PK
View Code? Open in Web Editor NEWOfficial PyTorch implementation of "Towards Deeper Graph Neural Networks" [KDD2020]
Home Page: https://arxiv.org/abs/2007.09296
License: GNU General Public License v3.0
Official PyTorch implementation of "Towards Deeper Graph Neural Networks" [KDD2020]
Home Page: https://arxiv.org/abs/2007.09296
License: GNU General Public License v3.0
Thanks for sharing your awesome work, but I can't find the paper here.
would you like to release pdf version of the paper? or you can share it with me. My email is [email protected].
Thanks anyway
HI, could you please provide the version of PyG? I met an error "AttributeError: type object 'GCNConv' has no attribute 'norm'
" when I ran the code.
0%| | 0/100 [00:00<?, ?run/s]Traceback (most recent call last):
File "E:/machine learning/spectral and algebraic theory/20200814Myself/DeeperGNN-master/DeeperGNN/dagnn.py", line 113, in
run(dataset, Net(dataset), args.runs, args.epochs, args.lr, args.weight_decay, args.early_stopping, permute_masks, lcc=False)
File "E:\machine learning\spectral and algebraic theory\20200814Myself\DeeperGNN-master\DeeperGNN\train_eval.py", line 121, in run
eval_info = evaluate(model, data)
File "E:\machine learning\spectral and algebraic theory\20200814Myself\DeeperGNN-master\DeeperGNN\train_eval.py", line 175, in evaluate
pred = logits[mask].max(1)[1]
RuntimeError: cannot perform reduction function max on tensor with no elements because the operation does not have an identity
How to draw the Figure 3 of DeeperGNN paper ?
Hi,
I want to test the performance on adaptive adjustment mechanism. If the code of adaptive adjustment mechanism is
pps = torch.stack(preds, dim=1) # nxkxc
retain_score = self.proj(pps) # nxkx1
retain_score = retain_score.squeeze() # nxk
retain_score = torch.sigmoid(retain_score)
retain_score = retain_score.unsqueeze(1) # nx1xk
out = torch.matmul(retain_score, pps).squeeze() # nx1xc -> nxc
After i comment out these lines and use preds[-1] as out, the performance of test accuracy declines to 0.397. It is even lower than MLP. So, Are these the code of adaptive adjustment mechanism?
**Hi, Thx for your nice work!
I got this error (Actually, all datasets got the same error):**
$ bash run.sh
=====Cora=====
---Fiexd Splits---
Downloading https://github.com/kimiyoung/planetoid/raw/master/data/ind.cora.x
Traceback (most recent call last):
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1318, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1239, in request
self._send_request(method, url, body, headers, encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1285, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1234, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1026, in _send_output
self.send(msg)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 964, in send
self.connect()
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1392, in connect
super().connect()
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 936, in connect
(self.host,self.port), self.timeout, self.source_address)
File "C:\ProgramData\Anaconda3\lib\socket.py", line 704, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "C:\ProgramData\Anaconda3\lib\socket.py", line 745, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno 11004] getaddrinfo failed
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "dagnn.py", line 84, in
dataset = get_planetoid_dataset(args.dataset, args.normalize_features)
File "F:\PapersCode\DeeperGNN\DeeperGNN\datasets.py", line 9, in get_planetoid_dataset
dataset = Planetoid(path, name)
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\datasets\planetoid.py", line 55, in init
super(Planetoid, self).init(root, transform, pre_transform)
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\data\in_memory_dataset.py", line 54, in init
pre_filter)
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\data\dataset.py", line 89, in init
self._download()
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\data\dataset.py", line 141, in _download
self.download()
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\datasets\planetoid.py", line 105, in download
download_url('{}/{}'.format(self.url, name), self.raw_dir)
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\data\download.py", line 31, in download_url
data = urllib.request.urlopen(url)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 223, in urlopen
return opener.open(url, data, timeout)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 532, in open
response = meth(req, response)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 564, in error
result = self._call_chain(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 756, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 526, in open
response = self._open(req, data)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 544, in _open
'_open', req)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1361, in https_open
context=self._context, check_hostname=self._check_hostname)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1320, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [Errno 11004] getaddrinfo failed>
Then I changed the DNS. However, I got another error:
$ bash run.sh
=====Cora=====
---Fiexd Splits---
Downloading https://github.com/kimiyoung/planetoid/raw/master/data/ind.cora.x
Traceback (most recent call last):
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1318, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1239, in request
self._send_request(method, url, body, headers, encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1285, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1234, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1026, in _send_output
self.send(msg)
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 964, in send
self.connect()
File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1400, in connect
server_hostname=server_hostname)
File "C:\ProgramData\Anaconda3\lib\ssl.py", line 407, in wrap_socket
_context=self, _session=session)
File "C:\ProgramData\Anaconda3\lib\ssl.py", line 814, in init
self.do_handshake()
File "C:\ProgramData\Anaconda3\lib\ssl.py", line 1068, in do_handshake
self._sslobj.do_handshake()
File "C:\ProgramData\Anaconda3\lib\ssl.py", line 689, in do_handshake
self._sslobj.do_handshake()
ConnectionResetError: [WinError 10054] Զ▒▒▒▒▒▒ǿ▒ȹر▒▒▒һ▒▒▒▒▒е▒▒▒▒ӡ▒
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "dagnn.py", line 84, in
dataset = get_planetoid_dataset(args.dataset, args.normalize_features)
File "F:\PapersCode\DeeperGNN\DeeperGNN\datasets.py", line 9, in get_planetoid_dataset
dataset = Planetoid(path, name)
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\datasets\planetoid.py", line 31, in init
super(Planetoid, self).init(root, transform, pre_transform)
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\data\in_memory_dataset.py", line 53, in init
pre_filter)
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\data\dataset.py", line 82, in init
self._download()
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\data\dataset.py", line 118, in _download
self.download()
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\datasets\planetoid.py", line 45, in download
download_url('{}/{}'.format(self.url, name), self.raw_dir)
File "C:\ProgramData\Anaconda3\lib\site-packages\torch_geometric\data\download.py", line 31, in download_url
data = urllib.request.urlopen(url)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 223, in urlopen
return opener.open(url, data, timeout)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 532, in open
response = meth(req, response)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 564, in error
result = self._call_chain(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 756, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 526, in open
response = self._open(req, data)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 544, in _open
'_open', req)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1361, in https_open
context=self._context, check_hostname=self._check_hostname)
File "C:\ProgramData\Anaconda3\lib\urllib\request.py", line 1320, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [WinError 10054] Զ▒▒▒▒▒▒ǿ▒ȹر▒▒▒һ▒▒▒▒▒е▒▒▒▒ӡ▒>
I have found different solutions on the Internet, but nothing worked for me.
I would appreciate it if u could help me.
Thank you!
Hi Meng,
Open Graph Benchmark(OGB) is gaining its popularity as benchmarks for GNNs, compared to citation networks we normally use, they are more scalable and systematic. I'd like to see DAGNN's results on OGB, and I did some experiments myself on ogbn-arxiv by slightly modifying your code (making it work on SparseTensor). But I failed to reproduce a better accuracy compared to vanilla GCN. (GCN: 71.74%, while DAGNN only ~67%).
The Colab link is here. I tested K=5, 10, 20. Note that for consistency, I don't apply weight decay here since the GCN implementation doesn't either, and I don't think that would count for the 4% difference. Would you mind helping figure out what's wrong with my code or why this would happen? Thank you very much.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.