Code Monkey home page Code Monkey logo

end-vo's Introduction

END-VO

Introduction

Code of Endoscope Localization and Dense Surgical Scene Reconstruction for Stereo Endoscopy by Unsupervised Optical Flow and Kanade-Lucas-Tomasi Tracking.

demo_1.mp4

Setup

Install dependences required in the CMakeLists.txt

OpenCV 3.1 https://github.com/opencv/opencv/archive/3.1.0.zip

unzip opencv-3.1.0.zip
cd opencv-3.1.0
mkdir build
cd build 
cmake ..
make
sudo make install

pangolin

sudo apt-get install libglew-dev  
sudo apt-get install libboost-dev libboost-thread-dev libboost-filesystem-dev
sudo apt-get install git
git clone https://github.com/stevenlovegrove/Pangolin.git

cd Pangolin
mkdir build
cd build 
cmake ..
make
sudo make install

Sophus

git clone http://github.com/strasdat/Sophus.git
cd Sophus
mkdir build
cd build 
cmake ..
make
make install

G20

sudo apt-get install qt5-qmake qt5-default libqglviewer-dev-qt5 libsuitesparse-dev libcxsparse3 libcholmod3
git clone https://github.com/RainerKuemmerle/g2o.git
cd g2o
mkdir build
cd build 
cmake ..
make
sudo make install

glog

sudo apt update
sudo apt install libgoogle-glog-dev

gtest

git clone https://github.com/google/googletest.git
cd googletest
mkdir build
cd build
cmake ..
make
sudo make install

csparse

sudo apt-get install libsuitesparse-dev

Complie the project

mkdir build
cd build/
cmake ..
make -j4
sudo make install

Dataset

We used the SCARED dataset (https://arxiv.org/abs/2101.01133). Please feel free to send an email to [email protected] for the link to preprocessed dataset.

Run

Please change the dataset_dir and depth_dir in the config/endoscope0103.yaml and run:

bin/run_end_stereo --log_dir=. #save the poses to a specific folder
or
bin/run_end_stereo --logtostderr #save the poses to your current folder

Mesh

Please refer to http://www.open3d.org/docs/0.12.0/tutorial/pipelines/rgbd_integration.html and Endo-Depth-and-Motion](https://github.com/UZ-SLAMLab/Endo-Depth-and-Motion/tree/main)

Evaluation

For pose evaluation, please install evo (https://github.com/MichaelGrupp/evo) and go to the eva folder.

python evo_mydata.py
python plot_all.py

Fore reconstruction evaluation, please use (https://www.danielgm.net/cc/).

Citation

@inproceedings{yang2022endoscope,
  title={Endoscope Localization and Dense Surgical Scene Reconstruction for Stereo Endoscopy by Unsupervised Optical Flow and Kanade-Lucas-Tomasi Tracking},
  author={Yang, Zixin and Lin, Shan and Simon, Richard and Linte, Cristian A},
  booktitle={2022 44th Annual International Conference of the IEEE Engineering in Medicine \& Biology Society (EMBC)},
  pages={4839--4842},
  year={2022},
  organization={IEEE}
}

Acknowledgements

end-vo's People

Contributors

zixinyang9109 avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.