DenseNet FCN about vision HOT 12 CLOSED

@FuriouslyCurious
Here is the code of the model. Hopefully, it helps your research.
https://gist.github.com/felixgwu/045c887b6ccdf0edf4648da0c40bcc12

from vision.

Hi, @FuriouslyCurious I have an implementation of FC-DenseNet at head already.
I can submit a PR is needed.
However, I couldn't match their reported mIoU and accuracy by training from scratch.
I've submitted an issue to their repo, but he is busy to help these days.

from vision.

If you want to use sub-pixel convolution for upscaling you can use the PixelShuffle layer in PyTorch

from vision.

Haha who can say no to that 😄

The original implementation is in Theano. We could probably use the saved weights for that model, but it may be better to train from scratch.

It might make sense to hold off until the CamVid dataset is added (#90).

from vision.

Thank you @gpleiss and @felixgwu

I am planning to train a Dense FC model from scratch using medical data and publish the weights / trained model for medical research.

@felixgwu if you share the code in a GIST I will love to try it out for some experiments I am running.

from vision.

Thank you @felixgwu !

@ycszen FYI: DenseNet FCN code in GIST above ^

from vision.

Thank you! @FuriouslyCurious

from vision.

How can i import the saved weight in the original implementation in Theano to the pytorch with the same architechture? @felixgwu
As I know, the saved weight is numpy format. and it seem difficult to initial the weight in pytorch one by one, because the net is so deep. Thank you for advanced

from vision.

@felixgwu Do you remember how far you where off from the original reported mIoU and accuracy by training from scratch?

from vision.

I found your results in FC-DenseNet issue 11.
Did you manage to further improve the results?

from vision.

@EliasVansteenkiste and @felixgwu Check out the Keras Tiramisu implementation below: Developer @titu1994 used SubPixelConvolution instead of Deconvolution as default method for upsampling. Not sure if that helps accuracy, but worth trying.

https://github.com/titu1994/Fully-Connected-DenseNets-Semantic-Segmentation

from vision.

@felixgwu . Thank you for you code implementation of FC-DenseNet in pytorch. Recent, i want to reproduce the result about FC-DenseNet, but my loss does not converge at all. would you share me you dataLoader so that i can compare it with my code? and if i initialize the learning rate with 1e-3, the loss will be infinity. I am so puzzled with it .

from vision.