Not same with the Paper about pytorch_quantization HOT 3 OPEN

dorefa paper says ：'Here we assume the output of the previous layer has passed through a bounded activation function h, which ensures r ∈ [0, 1].'
But the paper does not specify what a bounded activation h is. I think multiplying activation by 0.1 can reduce the dynamic range of parameters and make the model perform better.I had an internship in megvii and they dealt with activation functions in this way.

from pytorch_quantization.

I think, DoReFa is fully integer calculation on the layers(without first, last layer).
multiplying activation by 0.1 is not quantized format, it need floating point calculation on feature map(my guess).
how do you think about it?

from pytorch_quantization.

yes, I think so.
in training time, we use simulation quantization, the activation layer inputs is the dequantize result. it's float format.

from pytorch_quantization.