Code Monkey home page Code Monkey logo

csci5922project's Introduction

Occupancy Network based 3D Image Reconstruction usingSingle-Depth View

(1) Architecture

Arch_Image

(2) Sample Results

Teaser_Image

(3) Data

Part 1: {ShapeNetCore.v2: bench, chair, couch, table}, 20G

https://drive.google.com/open?id=1rmOggF0ivB42KozMX3sQGD1CkZNOGCmM

Part 2: {ShapeNetCore.v2: airplane, car, monitor, faucet, guitar, gun}, 9.3G

https://drive.google.com/open?id=1zLQd68O73ZiwZ8S8qsLwwGYDcC5PiEdG

Real Dataset: {Kinect: bench, chair, couch, table}

https://drive.google.com/open?id=1wTE721q0r66Z6yyN68O1Tz4Bg5-aYnq3

(4) Requirements

python 2.7.6

tensorflow 1.2.0

numpy 1.13.3

scipy 0.19.0

matplotlib 2.0.2

skimage 0.13.0

(5) Run

Training

source venv/bin/activate
python main_3D-RecGAN++.py

Test Demo (Download model first)

python demo_3D-RecGAN++.py

Web Application Run Locally

source venv/bin/activate
python main.py

(6) Citation

@inProceedings{Yang18,
  title={Dense 3D Object Reconstruction from a Single Depth View},
  author = {Bo Yang
  and Stefano Rosa
  and Andrew Markham
  and Niki Trigoni
  and Hongkai Wen},
  booktitle={TPAMI},
  year={2018}
}

System Requirements:

Google Cloud Platform - Deep Learning VM Input Framework: PyTorch 1.4 + fast.ai 1.0 (CUDA 10.0) GPU: 1, nvidia-tesla-k80

We have referred to the code provided by the following citation for our implementation:

@inproceedings{Occupancy Networks,
    title = {Occupancy Networks: Learning 3D Reconstruction in Function Space},
    author = {Mescheder, Lars and Oechsle, Michael and Niemeyer, Michael and Nowozin, Sebastian and Geiger, Andreas},
    booktitle = {Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR)},
    year = {2019}
}

Our modifications to the original architecture is documented within the code.

Installing required packages using anaconda3, run the following commands:

conda env create -f environment.yaml conda activate mesh_funcspace

Compile the required extension modules:

python setup.py build_ext --inplace

Download the required pre-processed dataset (will be downloaded to data/ShapeNet folder)

Run in occupancy_networks_code directory.

bash scripts/download_data.sh

Training:

python train.py <CONFIG_FILE_DIRECTORY/onet.yaml>

Generation using pre-trained model:

python generate.py <CONFIG_FILE_DIRECTORY/onet_pretrained.yaml

csci5922project's People

Contributors

amitprospeed avatar souravchk25 avatar

Watchers

James Cloos avatar  avatar

Forkers

amitprospeed

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.