ELU used in sequence in CellAR about nvae HOT 5 CLOSED

Thanks for catching this. Technically, we shouldn't have two ELUs after each other. Unfortunately, fixing this requires retraining all our checkpoints again with the updated network. We will try to fix this in our future major revision.

from nvae.

Thanks a lot for your reply.

from nvae.

Hi @arash-vahdat
the decoder sampler cell is nn.ELU + Conv2D

I am curious about the difference between the encoder and decoder samplers. Is this a deliberated design?

from nvae.

encoder0 is an outlier (it is a kind of a legacy branch from some old idea that didn't work out. We will remove it in the future). The fact that the encoder sampler doesn't apply any activation function is by design. I think I did experiments at some point with adding an activation and normalization and I didn't see any improvements.

from nvae.

I see. Thanks a lot.

from nvae.