Code Monkey home page Code Monkey logo

Comments (1)

791136190 avatar 791136190 commented on August 22, 2024

大佬，您好！我看您的这份开源工作中只对每一层的权值与激活值进行了量化、反量化操作，然后输出作为下一层的输入，然后再作为下一层的输入作激活的量化反量化；但是我看别的一些量化代码中，除了对每一层的激活值、权值进行量化，还对每一层的输出进行量化、反量化，想请教一下大佬这是为啥？因为该层的输出量化不就是下一层的输入激活值量化吗？

实际中会有很多多分支操作，以及混合精度量化，所以每层都是完整的对输入，权重，输出都量化会更通用

from micronet.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.