Code Monkey home page Code Monkey logo

rgbd-integration-2020's Introduction

RGBD-Integration:

Applying Open3D functions to integrate experimentally measured color and depth frames into a 3D object. Data were obtained with Intel RealSense depth camera.

Open3d version: 0.9.0.0

List of files:

  • main__TSDF_Integrate__color_depth.py - run this Python script to perform integration of color and depth frames from Test_data folder

  • main__TSDF_Integrate__depth_only.py - run this Python script to perform integration of depth frames from Test_data folder

  • _background_substruction_v2.py - Segmentation relies on OpenCV morphological filter (see docs: https://docs.opencv.org/4.x/d9/d61/tutorial_py_morphological_ops.html) ! A .bag record of the background should be captured along with the subject's data. An averaged background image is removed from the subject's frames. Filters thresholds are selected empirically. Depth outside the subject's range is cut.

  • trajectory_io.py - Open3D class to generate Camera poses in the necessary format

  • Test_data - Folder with depth (and color) frames (43 MB). Depth frames must be '.png' of type 'np.uint16'.

  • expected_results - Folder with the correct camera trajectory ('test_segm.log') and volumetric models generated by the scripts.

Based on Open3D Tutorials:

Possible application:

rgbd-integration-2020's People

Contributors

ritchizh avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

rgbd-integration-2020's Issues

Data Capturing

Hello mam
I seen your rgbd integration repository the dataset which you were taken is working perfectly. I took another dataset and tried to reconstruct it but is not giving the proper output. But whenever I'm using the online datasets in your respository it was giving the proper results.
I recorded the two rosbag files using ros, Consists of both the color and the depth data after that I extracted the rgb and the depth data from those files and then performed the 3d reconstruction It was not giving the proper results can I know why it was happening ?
can you provide the proper details how you were captured the data?

Incorrect reconstruction result

Excuse me, the following is the result of reconstruction using my dataset. The dataset includes three groups of RGBD images, but the reconstruction results do not coincide well. What is the reason? Is the camera in your sample dataset fixed, rotating only by people? Is this necessary?
image
image
image
The following is the original picture(RGB picture):
A_hat1_color_frame0
A_hat1_color_frame1
A_hat1_color_frame2

I hope you can solve my problem. It has troubled me for a long time. Thank you!!

Some reconstructed results

Hello mam,
While, Scanning the small objects it was showing some incorrect reconstruct results. Some of the reconstructed results were
Screenshot from 2023-08-21 15-42-35
Screenshot from 2023-08-28 12-12-14
Screenshot from 2023-08-28 10-21-51
A_hat1_color_frame0 (2)
A_hat1_color_frame0 (1)
A_hat1_color_frame0

which open3d version to use?

python main__TSDF_Integrate__color_depth.py
Traceback (most recent call last):
File "main__TSDF_Integrate__color_depth.py", line 156, in
result_ransac = execute_global_registration(source_down, target_down,
File "main__TSDF_Integrate__color_depth.py", line 67, in execute_global_registration
result = o3d.pipelines.registration.registration_ransac_based_on_feature_matching(
TypeError: registration_ransac_based_on_feature_matching(): incompatible function arguments. The following argument types are supported:
1. (source: open3d.cuda.pybind.geometry.PointCloud, target: open3d.cuda.pybind.geometry.PointCloud, source_feature: open3d::pipelines::registration::Feature, target_feature: open3d::pipelines::registration::Feature, mutual_filter: bool, max_correspondence_distance: float, estimation_method: open3d.cuda.pybind.pipelines.registration.TransformationEstimation = TransformationEstimationPointToPoint without scaling., ransac_n: int = 3, checkers: List[open3d.cuda.pybind.pipelines.registration.CorrespondenceChecker] = [], criteria: open3d.cuda.pybind.pipelines.registration.RANSACConvergenceCriteria = RANSACConvergenceCriteria class with max_iteration=100000, and confidence=9.990000e-01) -> open3d.cuda.pybind.pipelines.registration.RegistrationResult

Invoked with: PointCloud with 2923 points., PointCloud with 2580 points., Feature class with dimension = 33 and num = 2923
Access its data via data member., Feature class with dimension = 33 and num = 2580
Access its data via data member., 0.015, TransformationEstimationPointToPoint without scaling., 4, [CorrespondenceCheckerBasedOnEdgeLength with similarity_threshold=0.900000, CorrespondenceCheckerBasedOnDistance with distance_threshold=0.015000], RANSACConvergenceCriteria class with max_iteration=4000000, and confidence=1.000000e+00

Dataset

Hello, I am a college student. I started learning 3D reconstruction recently. Your public 3D reconstruction project has given me great help and inspiration. I can't express my gratitude in words! And your dataset is complete. Can I have the honor to use your dataset to verify the algorithm and publish in my article? Looking forward to your reply!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.