Code Monkey home page Code Monkey logo

self-sample's Introduction

Self-Sampling - for neural point cloud consolidation

We introduce a novel technique for neural point cloud consolidation which learns from only the input point cloud.

by Gal Metzer, Rana Hanocka, Raja Giryes, and Daniel Cohen-Or

Getting Started

Installation

  • Clone this repo:

Setup Conda Environment

  • Relies on PyTorch version 1.7.1
  • Pytorch Geometric
  • Everything can be installed via conda environment conda env create -f env.yml (creates an environment called self-sample)

Running Examples

The demos folder contains examples from the paper.
For each shape the demo runs the optimization and inference parts.
For instance, to run the lamp demo simply execute from the root project folder:

demos/lamp.sh

The results would be found at demos-results/lamp/lamp_result.xyz,
and respectively for the other shapes as well.

Example shapes

  • alien, anchor, lamp - sharp point consolidation
  • candle, scanned Leg, tiki - sparse point consolidation
  • camera_noised - denoising

Citation

If you find this code useful, please consider citing our paper

@article{metzer2020self,
author = {Metzer, Gal and Hanocka, Rana and Giryes, Raja and Cohen-Or, Daniel},
title = {Self-Sampling for Neural Point Cloud Consolidation},
year = {2021},
issue_date = {October 2021},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {40},
number = {5},
issn = {0730-0301},
url = {https://doi.org/10.1145/3470645},
doi = {10.1145/3470645},
}

Questions / Issues

If you have questions or issues running this code, please open an issue.

Note: the original implementation used this implementation of PointNet++, which is not guaranteed to supported newer versions of pytorch.
This implementation uses Pytorch Geometric instead, which can not hold large subsets at train time.

Therefore, demos are designed for subset sizes lower than used in the paper. Increasing the subset size to 12K-14K on an appropriate GPU, improves the accuracy of the results.

self-sample's People

Contributors

galmetzer avatar ranahanocka avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

self-sample's Issues

The point cloud scanning software used by Intel RealSense SR300 scanner

Hi, thanks for your impressive work!

Your results, especially under real scans scanned by SR300, are very robust for different point cloud artifacts.

So I want to experiment self-sample with more real scans scanned by my own SR300, but I only scanned depth maps before based on SDK thus I am not very familiar with point cloud scanning.

My question is which software are used by Intel RealSense SR300 scanner to scan the point cloud? The software in the official SDK is not very convenient for object scanning. Besides, I have found itSeez3D, but it seems can only produce mesh but not point cloud.

Looking forward to your reply.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.