Code Monkey home page Code Monkey logo

hegn's Introduction

HEGN: Hierarchical Equivariant Graph Neural Network for 9DoF Point Cloud Registration

This repository is the non official implementation of the paper:

*Hierarchical Equivariant Graph Neural Network for 9DoF Point Cloud Registration

๐Ÿ— Setup

  1. Clone and set up the HEGEN repository
git clone 
cd HEGN

# set up virtual environment.
conda env create -f environment.yaml
conda activate hegn

# set up the HEGN python package
pip install -e .

๐Ÿ–ผ๏ธ Prepare dataset

Synthetic ModelNet40 dataset

HEGN is evaluated on the synthetic ModelNet40 dataset. to download the dataset, run the following command:

python dataloader/dataloader.py

Real-world ScanObjectNN dataset

HEGN is evaluated on the real-world ScanObjectNN dataset. to download the dataset, run the following command:

๐Ÿš€ Run

train HEGN on ModelNet40 dataset

python scripts/train.py

Evaluate HEGN on ModelNet40 dataset

python scripts/evaluate.py

train HEGN on ScanObjectNN dataset

Evaluate HEGN on ScanObjectNN dataset

๐Ÿ“” Abstract

Given its wide application in robotics, point cloud registration is a widely researched topic. Conventional methods aim to find a rotation and translation that align two point clouds in 6 degrees of freedom (DoF). However, certain tasks in robotics, such as category-level pose estimation, involve non- uniformly scaled point clouds, requiring a 9DoF transform for accurate alignment. We propose HEGN, a novel equivariant graph neural network for 9DoF point cloud registration. HEGN utilizes equivariance to rotation, translation, and scaling to estimate the transformation without relying on point corre- spondences. Based on graph representations for both point clouds, we extract equivariant node features aggregated in their local, cross-, and global context. In addition, we introduce a novel node pooling mechanism that leverages the cross-context importance of nodes to pool the graph representation. By repeating the feature extraction and node pooling, we obtain a graph hierarchy. Finally, we determine rotation and translation by aligning equivariant features aggregated over the graph hierarchy. To estimate scaling, we leverage scale information in the vector norm of the equivariant features. We evaluate the effectiveness of HEGN through experiments with the synthetic ModelNet40 dataset and the real-world ScanObjectNN dataset. The results show the superior performance of HEGN in 9DoF point cloud registration and its competitive performance in conventional 6DoF point cloud registration.

๐Ÿ‘ฉโ€โš–๏ธ License

For academic usage, the code is released under the MIT license. For any commercial purpose, please contact the authors.

hegn's People

Contributors

abwerby avatar luisbgn avatar mojtabanik avatar

Stargazers

Can Li avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.