Code Monkey home page Code Monkey logo

Comments (5)

xiaodongdu avatar xiaodongdu commented on May 25, 2024

I'll work on this.

from sidewinder.

scherukuri11 avatar scherukuri11 commented on May 25, 2024

I will start working on this issue

from sidewinder.

ambud avatar ambud commented on May 25, 2024

@scherukuri11 thanks

from sidewinder.

ambud avatar ambud commented on May 25, 2024

Sidewinder storage engines have been redesigned to follow true columnar storage design pattern with independent storage and compression for time and value columns. This has enabled the backend to support projection limitation on Apache Calcite query engine and Avatica server for direct JDBC. d7d5010

So far the proof of concept design works however a lot of corner cases have to be fixed and currently this is extremely brittle. Phase 2 of this development is to solidify the query planner and validate queries work as expected. Also extend Tag support to columns rather than single field and also add where clause to tag index mapping.

Phase 3 implementation will need to include memory optimization and tuning to ensure large queries are automatically capped so as to not run out of memory. Also additional tuning is needed for reducing memory footprint for high cardinality measurements. Investigation for pagination capabilities is also critical to reduce heap usage. Lastly implementation of calcite time operators (streaming) can be applied to time series functions in Sidewinder.

Note: that as of 0.2.x the key value pair based tag indices are now available allowing tags to be treated as traditional column values.

from sidewinder.

ambud avatar ambud commented on May 25, 2024

Committed phase 1 to development e4c713a

from sidewinder.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.