Comments (5)
What are the differences are you seeing?
Did you use prepare model API?
from aimet.
I printed the output results of both and the results were completely inconsistent. I did not use the prepare model API
from aimet.
If you are performing QAT, then weights are expected to change (in order to reduce the quantization noise) which is reflected in the exported model.
from aimet.
My QAT fine is over, the optimal.pth model saved in the finetune process, and the pth exported by the optimal.pth model export should be consistent. I don't understand what's new here that's causing the model to turn out differently
from aimet.
If you look at the model saved by save_checkpoint it is a quantsim model whereas .export exports out a model without Quantization wrappers.
from aimet.
Related Issues (20)
- Float quantizer api reference
- [PART 2] Deprecate pytorch autoquant v1
- [PART 2] Deprecate pytorch autoquant v1
- aimet v 1.31.0 installation HOT 2
- Save torch encodings with 1.0.0 export
- Updating Float Quantizer Documentation
- Export model by using Aimet for AI stack stable diffusion demo HOT 1
- Invalid constructore argument StaticGridPerTensorQuantizer HOT 11
- A way to perform activation encoding freezing with aimet_tensorflow HOT 1
- Loading model in google co-lab
- Update in default config to disable the output quantizers of cast op
- [PART 4] Deprecate pytorch autoquant v1
- AIMET 1.32.0 with torch 2.1 HOT 3
- Example Notebook for ONNX AdaRound
- Key Error auto_quant.optimize
- Bokeh server failing with an unknown error (occurs randomly)
- Where to find aimet_torch.pro? HOT 1
- Add utility to clip weights to 7f7f
- Add select op
- Implement cpp lpbq scale calculation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aimet.