Code Monkey home page Code Monkey logo

aminebdj / openyolo3d Goto Github PK

View Code? Open in Web Editor NEW
58.0 6.0 4.0 7.57 MB

Our OpenYOLO3D model achieves state-of-the-art performance in Open Vocabulary 3D Instance Segmentation on ScanNet200 and Replica datasets with up ∼16x speedup compared to the best existing method in literature.

Python 80.96% Shell 0.21% C++ 0.75% Cuda 0.97% Dockerfile 0.02% Jupyter Notebook 17.07% CMake 0.02%
3d-computer-vision instance-segmentation open-vocabulary point-clouds

openyolo3d's People

Contributors

aminebdj avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

openyolo3d's Issues

Can't able to download replica dataset

Hi Author,

I have few doubts regarding the testing dataset.

  1. I am trying to download the Replica dataset but am unable to do so. How to do it? i am using
    sh scripts/get_class_agn_masks.sh.
  2. Can you please explain how to generate the ground truth, poses, depth and point clouds (.ply) files? If possible, could you share the data?
  3. Are you generating .ply through gaussian_splatting?
    These will be very helpful to test datasets to run with custom dataset.

Thank you in advance.

About the "text" input during evaluation

Dear authors,

Thank you for your awesome work and for releasing the code.

I found that at the run_evaluation.py, the text in the prediction = openyolo3d.predict() function is missing. I believe the text is necessary since as shown in the network architecture figure of your paper, the input contains the text, which plays an important role in making this method outstanding.

Could you please add the text into this function input, or explain this if the text is not needed in the evaluation process?

Thank you!

Text-guided promptable segmentation

Dear authors,

Thanks for your fantastic work. It is very beneficial to the community of the 3D OV segmentation research field. May I ask if OpenYOLO3D enables segmentation with text prompts similar to SAM in 2D?

Thanks.

Best wishes,
Ye

Challenges in Reproducing ScanNet200 Results

Dear @aminebdj ,

Thank you again for your outstanding work! I have followed the instructions to reproduce the results. However, I encountered significant discrepancies when trying to reproduce the results for ScanNet200 using both precomputed masks and oracle 3D masks. The results I obtained are quite different from those reported in the paper. I have attached the results for both cases.

Could you please provide any insights or guidance on how to accurately reproduce the results?

Thank you very much!

Results of ScanNet200 with precomputed-masks:
results of ScanNet200 with precomputed-masks

Results of ScanNet200 with oracle 3D masks:
results of ScanNet200 with oracle 3D masks

Code for visualizations

Hi authors,

Thank you for releasing the code for this great work!

I was able to successfully reproduce the performance in the paper.

But, I still wonder if there is any way that I can visualize the results.

Do you have any plan to release codes for visualizations?

or Would you give me a sample script / code that I can develop on for the visualizations?

Please feel free to contact through my email if you prefer email over github issue for sharing the code!

Email: shjung13 [at] cs.washington.edu

Thank you!

Best,
Sanghun

Missing 'num_classes Parameter in Config Files for ScanNet200 and Replica Datasets

Hi,

Thank you so much for this great work! However, when I try to run the code, I noticed that the 'num_classes' parameter is missing in the config files for both the ScanNet200 and Replica datasets. This causes an error at line 256 in utils/init.py. Could you please let me know what values I should set for 'num_classes' for these datasets?

Thank you very much!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.