itayhubara / calibtip Goto Github PK
View Code? Open in Web Editor NEWImproving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
License: MIT License
Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming
License: MIT License
Line 481 in 69077c9
[0] index into the first batch.
isn't sequential adaquant supposed to update the input cache of all batches to the quantized values?
Hi!
Thanks for your work! In Table 2, you showed the results of w4a4 configuration for ResNet models. But you omitted the result of MobileNet-V2 at that table. From figure 3, it's hard to know the exact value of quantized MobileNet-V2. May I know w4a4 quantized MobileNet-V2, please?
when i use advanced_pipeline.sh, and i achieve bugs at line 3 "sh scripts/integer-programing.sh resnet resnet50 4 4 8 8 50 loss True",
which is 'No such file or directory: 'results/resnet50_w8a8.adaquant/IP_resnet50_loss.txt'.
How can I fix it? Thanks for response~
Hello. I was trying to running the code as per instructed but got this error while running the code. Is there anything I am missing to add during the run? Please look into the errors.
main.py: error: invalid checkpoint: results/resnet50_w8a8/resnet.absorb_bn.measure_perC
error: argument -e/--evaluate: expected one argument
Good afternoon,
I found your paper very interesting and wanted to try out your code. I have a several questions I would be grateful if you could answer:
Hi there!
In your paper https://arxiv.org/abs/2006.10518 there is a parameter V which was added to the weights of some layer in formula (2) or (3) and which should be optimized to minimize MSE between original and quantized outputs.
However, I can't find this offset parameter in your current repo. Is there something I have missed or you have decided to remove this parameter?
Hello and thank you for an interesting paper!
I have a question concerning the optimization of the quantization step size. In section D.1 of the paper, you mentioned the usage of Adam optimizer for solving the AdaQuant optimization problem, but I have failed to find a description of the methodology used for backpropagating gradients through formally nondifferentiable rounding operation. Is it just Straight Through Estimator?
Thank you for your time and consideration.
What data are you use in /media/drive/Datasets/imagenet/calib?
This implies to calculate MSE between relu(conv_out) for conv1 and conv2 layers
Line 124 in 69077c9
But in ResNet architecture, conv2 is not followed by a direct Relu. Instead it follows by a residual addition, then Relu.
Line 71 in 69077c9
Line 79 in 69077c9
Line 80 in 69077c9
How was this difference justified?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.