Microsoft Graphormer rewritten in PyTorch-Geometric
- Centrality Encoding
- Spatial Encoding
- Edge Encoding
- Multi-Head Self-Attention
This implementation differs from the original implementation in the paper in following ways:
- No [VNode] ([CLS] token analogue in BERT)
- The shortest path algorithm is not mentioned in the paper. This repository uses Floyd-Warshall