Code Monkey home page Code Monkey logo

lps-net's Introduction

LPS-Net

Lightweight and Progressively-Scalable Networks for Semantic Segmentation

The original paper can be found here.

Speed-mIoU

Comparisons of inference speed/accuracy tradeoff on Cityscapes validation set. Inference speed of LPS-Net (-S, -M, and -L) are measured on an NVIDIA GTX 1080Ti GPU with TensorRT.

Getting Started

Requiremenets

Package Version
torch 1.9.0+cu111
torchvision 0.10.0+cu111
numpy 1.21.1
onnx 1.10.0
onnx-simplifier 0.3.6
Pillow 8.3.1
TensorRT 7.1.3.4

Evaluation in Command Line

To evaluate the LPS-Net-S on the Cityscapes validation set with "val_miou.py", first setup the Cityscapes dataset and update data path in "imagelist_val.txt"/"val_miou.py" and (if needed), then run:

python val_miou.py

The expected output is:

Total 500 images for validation.
LPS-Net-S on Cityscapes validation set: mean IoU=73.9%

Measure the Latency

To measure the latency of LPS-Net-S on your device with TensorRT in FP32 mode, run:

python latency.py

Please ensure the TensorRT has been correctly installed and configured.

Files in Repository

File Content
val_miou.py Evaluate the mean IoU performance of LPS-Net-S on Cityscapes validation set.
latency.py Measure the latency of LPS-Net with TensorRT in FP32 mode.
lpsnet.py Definitions and implementation of LPS-Net.
expand.py Progressive expansion of LPS-Net.
LPS-Net-S.pth Weights of LPS-Net-S. It is trained on the Cityscapes training set.
imagelist_val.txt A list of image-label pairs on the Cityscapes validation set. It is utilized to evaluate mean IoU performace in "val_miou.py". Note that the label images should use official "trainId".

Citation

Cite as below if you find this repository is helpful:

@article{zhang2022lpsnet,
  title   = {Lightweight and Progressively-Scalable Networks for Semantic Segmentation},
  author  = {Zhang, Yiheng and Yao, Ting and Qiu, Zhaofan and Mei, Tao},
  journal = {ArXiv},
  year    = {2022},
  volume  = {abs/2207.13600}
}

lps-net's People

Contributors

yihengzhang-cv avatar

Stargazers

CHC avatar Cheng Feng avatar Crisis K avatar rotorliu avatar  avatar see小高 avatar Zeyu Chen avatar Roronoa-Zoro avatar uyolo avatar  avatar Jhin avatar hanjr avatar Chenyu Lu avatar  avatar  avatar xiaofei sun avatar yhq avatar yaoshun li avatar  avatar  avatar  avatar lawlaw avatar James Rainey avatar  avatar Cat avatar 爱可可-爱生活 avatar Kong Yi avatar Roland avatar  avatar 顾立辉 avatar  avatar  avatar Jian.Yin avatar makex1n avatar marcovaldo avatar  avatar  avatar Tim avatar Brian Pugh avatar ray0809 avatar Dong ZHANG avatar  avatar An-zhi WANG avatar LalKrishna Arjun avatar  avatar Shaina Mehta avatar Jenisha avatar  avatar  avatar  avatar  avatar  avatar Ashish Patel avatar

Watchers

Jian.Yin avatar  avatar  avatar

lps-net's Issues

Training results on ImageNet and Cityscapes

I trained the lpsnet-m on ImageNet 1k for 100 epoch with batch size 1024.The detials are as follows:
Optimizer:
image
Data augments:
image
Eval dataset:
image
result:
image

Then I use the pre-trained model to train a lpsnet-m on cityscapes for 180k iterations with batch size 16. The detials are as follows:
Loss function:
image
lr_scheduler:
image
Optimizer:
image
Data augments:
image
Eval dataset:
image
Result:
image

ImageNet pre-train and cityscapes training settings

I'm wondering that did the miou score reported by table 5 in the paper use the ImageNet pre-trained?
And can you provide the exact training settings of ImageNet pre-train and cityscapes, including but not limited to data augments、optimizer settings and so on.
Thank you in advance!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.