Code Monkey home page Code Monkey logo

Comments (2)

g1mv avatar g1mv commented on September 17, 2024

Hello Piotr thanks for this.
Two things need verification :

  • histogram counting not being too penalizing for performance
  • reverting from one mode to another not being too penalizing for performance either (dictionary backups etc.)

The loss on the sao file is only 2%, so kernel switching should have a near-zero performance hit for it to be considered a benefit, as 95+% of files tested are better compressed with 2-bit mode compared to 1-bit.

from density.

tarsa avatar tarsa commented on September 17, 2024

Hi,

I've just realized that the potential gains of fallback would be rather small and present only on hardly compressible blocks. Therefore there's no sense of testing for fallback on well compressible blocks. It would make sense then the compression ratio is worse than about 80% - 90% (ie as percentage of original size) and the compressed stream without signatures is less than about 95% of original size (because otherwise the block is incompressible anyway).

But even if it would work, then 2% - 3% improvement in compression ratio on hardly compressible files wouldn't offset even the penalty of having to recompress the block. Maybe I was just too quick to try to improve things and forgot the emphasis on speed :)

Thanks for attention and have a nice day!

from density.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.