Code Monkey home page Code Monkey logo

deepdof's Introduction

Lingbo Jin1, Yubo Tang1, Yicheng Wu, Jackson B. Coole, Melody T. Tan, Xuan Zhao, Hawraa Badaoui, Jacob T. Robinson, Michelle D. Williams, Ann M. Gillenwater, Rebecca R. Richards-Kortum, and Ashok Veeraraghavan

1 equal contribution

Reference github repository for the paper Deep learning extended depth-of-field microscope. Proceedings of the National Academy of Sciences 117.52 (2020) If you use our dataset or code, please cite our paper:

@article{jin2020deep,
  title={Deep learning extended depth-of-field microscope for fast and slide-free histology},
  author={Jin, Lingbo and Tang, Yubo and Wu, Yicheng and Coole, Jackson B and Tan, Melody T and Zhao, Xuan and Badaoui, Hawraa and Robinson, Jacob T and Williams, Michelle D and Gillenwater, Ann M and others},
  journal={Proceedings of the National Academy of Sciences},
  volume={117},
  number={52},
  pages={33051--33060},
  year={2020},
  publisher={National Acad Sciences}
}

Dataset

Dataset can be downloaded here: the training, validation, and testing dataset used in the manuscript

The dataset contains:

  • 600 microscopic fluorescence images of proflavine-stained oral cancer resections (10×/0.25-NA, manual refocusing)
  • 600 histopathology images of healthy and cancerous tissue of human brain, lungs, mouth, colon, cervix, and breast from The Cancer Genome Atlas (TCGA) Cancer FFPE slides.
  • 600 INRIA Holiday dataset

In total, it contains 1,800 images (each 1,000 × 1,000 pixels; gray scale)

The 1,800 images were randomly assigned to training, validation, and testing sets that contained 1,500; 150; and 150 images, respectively

Code

dependencies

Required packages and versions can be found in deepDOF.yml. It can also be used to create a conda environment.

training

We use a 2 step training process. Step 1 (DeepDOF_step1.py) does not update the optical layer and only trains the U-net. Step 2 (DeepDOF_step2.py) jointly optimizes both the optical layer and the U-net

testing

To test the trained network with an image, use test_image_all_720um.py

Reference

Wu, Yicheng, et al. "Phasecam3d—learning phase masks for passive single view depth estimation." 2019 IEEE International Conference on Computational Photography (ICCP). IEEE, 2019.

deepdof's People

Contributors

mj2695 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

deepdof's Issues

some questions about training

Hello,
I am currently attempting to replicate your results.
However, while training with the specified training dataset and configuration for step 1, I've noticed that the losses seem to oscillate continuously.
Could you please help me determine if these results are normal? Or is it possible that I haven't trained for enough iterations?
图片1
图片2
图片3
图片4

For detail of Optical System

Dear Author,
Thank you for your great work! Actually, I am new to computational imaging, There are a few things I don't understand:
1.In the simulation phase mask, why use a 25*25 pixel pupil and then multiply it by 71/25 at the the relative displacement?
2.I want to ask which plane the in-focus depth refers to from the object plane.
3.I would like to know how to calculate the focal length of a microscopic optical system, in order to calculate the spatial domain size of a simulated psf.
Please help me! Thank you very much!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.