Comments (3)
Hi
TL;DR: just use a ResNet-101 trained on ImageNet without dilated convolutions.
In my opinion, if one consider a ResNet-101 with dilated convolution as described by Yu and Kolten [1] (without the context network), the receptive field of all neurons are the exact same between ResNet-101 and ResNet-101 with dilated convolutions. Indeed, increasing dilation factor in dilated convolutions emulates the effect of max pooling.
So, if you can take a ResNet-101 trained on ImageNet, you can outputs dense predictions (on the 1000 classes) using dilated convolutions, without having to train a specific model with the dilated convolutions.
This can be very useful. For instance, in DeepLabv3 [2], Chen train a model at resolution 1/16 due to memory limitations and produces dense predictions at resolution 1/8 at testing time.
Howewer, still remains that the first layers modifications (three 3x3 conv in PSPNet instead of 7x7 conv in ResNet)
[1] Yu, Fisher, and Vladlen Koltun. "Multi-scale context aggregation by dilated convolutions." arXiv preprint arXiv:1511.07122 (2015).
[2] Chen, Liang-Chieh, et al. "Rethinking Atrous Convolution for Semantic Image Segmentation." arXiv preprint arXiv:1706.05587 (2017).
from pspnet.
@howard-mahe
May I ask why
remains that the first layers modifications (three 3x3 conv in PSPNet instead of 7x7 conv in ResNet)
What's the problem of using the 7x7?
from pspnet.
I don't know, only the author could answer.
anyway, the main constribution of PSPNet is (1) the PSP module and (2) large crop, large batch and fine tuning BN parameters matters but requires multi gpu training.
from pspnet.
Related Issues (20)
- PASCAL VOC 2012
- Questions about PSPNet. HOT 6
- small size
- Reason to have a fixed inference size (473x473) HOT 1
- 请问下怎么将BVLC/caffe下的bn转换到BN?
- question about pooling layer
- Make Runtest Error HOT 2
- Invalid MEX-file '/media/sgp1053c/DATA/PSPNET-cudnn5/matlab/+caffe/private/caffe_.mexa64
- Make Error
- model performance
- C++ Prediction/Segmentation Code for PSPNet
- Could you provide the prototxt file for training PSPNet?
- [FIXED] Why are scale_factors used to scale pixel values? HOT 1
- Evaluation code
- OSX hdf5 make error HOT 1
- Hi, GPU GTX 1070 8G memory is not enough? HOT 1
- compile using cmake failed! (undefined reference to `pthread_create')
- Problem with evaluation
- math_functions.cu:375 [Check failed: status== CURAND_STATUS_SUCCESS (201 VS. 0) CURAND_STATUS_LAUNCH_FAILURE]
- TBD
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pspnet.