Code Monkey home page Code Monkey logo

st3d's Introduction

ST3D

Code release for the paper ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection, CVPR 2021

framework

Authors: Jihan Yang*, Shaoshuai Shi*, Zhe Wang, Hongsheng Li, Xiaojuan Qi (*equal contribution)

[arXiv];

Introduction

Our code is based on OpenPCDet v0.2. More updates on OpenPCDet are supposed to be compatible with our code.

Model Zoo

Waymo -> KITTI TASK

method Car@R11 Car@R40 download
SECOND-IoU ST3D 63.53 62.19 model
PVRCNN ST3D 62.76 64.05 model
SECOND-IoU ST3D (w/ sn) 73.33 73.62 model
PVRCNN ST3D (w/ sn) 75.71 77.33 model

We could not provide the above pretrained models due to Waymo Dataset License Agreement, but you should achieve similar performance by training with the default configs.

Also, the training Waymo data used in our work is version 1.0, but the version now available is version 1.2. The pretrained model on these two version data should be similar when adapted to KITTI.

nuScenes -> KITTI TASK

method Car@R11 Car@R40 download
SECOND-IoU Source Only 22.55 17.92 model
SECOND-IoU ROS 28.31 25.37 model
SECOND-IoU SN 25.26 21.23 model
SECOND-IoU ST3D 55.72 55.19 model
SECOND-IoU ST3D (w/ SN) 62.55 62.27 model
PV-RCNN Source Only 40.35 37.17 model
PV-RCNN ROS 40.90 38.84 model
PV-RCNN SN 50.62 49.47 model
PV-RCNN ST3D 68.54 71.11 model
PV-RCNN ST3D (w/ SN) 72.44 73.16 model

We provide all pretrained models here for nuScenes > KITTI task.

Waymo -> nuScenes TASK

method Car@R11 Car@R40 download
SECOND-IoU ST3D 23.24 20.19 model
PVRCNN ST3D 27.18 22.99 model
SECOND-IoU ST3D (w/ sn) 23.52 20.38 model
PVRCNN ST3D (w/ sn) 28.06 23.67 model

We could not provide the above pretrained models due to Waymo Dataset License Agreement, but you should achieve similar performance by training with the default configs.

Installation

Please refer to INSTALL.md for the installation.

Getting Started

Please refer to GETTING_STARTED.md to learn more usage about this project.

Supported features and ToDo List

  • Support inference and pre-trained model

  • Support training code on Waymo -> KITTI task

  • Update to Latest OpenPCDet version.

  • Support more adaptation tasks.

License

Our code is released under the Apache 2.0 license.

Acknowledgement

Our code is heavily based on OpenPCDet v0.2. Thanks OpenPCDet Development Team for their awesome codebase.

Citation

If you find this project useful in your research, please consider cite:

@inproceedings{yang2021st3d,
    title={ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection},
    author={Yang, Jihan and Shi, Shaoshuai and Wang, Zhe and Li, Hongsheng and Qi, Xiaojuan},
    booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
    year={2021}
}
@misc{openpcdet2020,
    title={OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Clouds},
    author={OpenPCDet Development Team},
    howpublished = {\url{https://github.com/open-mmlab/OpenPCDet}},
    year={2020}
}

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.