Code Monkey home page Code Monkey logo

tpc_h_htap's Introduction

TPC-H and TPC-H Skew HTAP Workload

This project helps you to create INSERT, DELETE and UPDATE queries for TPC-H and TPC-H Skew.

There isn't any proper HTAP workload with skewed datasets. There for I have generated INSERT, DELETE and UPDATE queries for TPC-H Skew. This can be used with TPC-H as well.

How to setup TPC-H Skew (TPC-H setup is similar)

Initially you need to have the TPCH-Skew setup

Download and Build the project.: https://www.microsoft.com/en-us/download/details.aspx?id=52430

I assume you already have a working project and have already generated data for your database.

Here we will discuss how you can generate INSERT, DELETE and UPDATE queries for TPC-H Skew.

datagen.exe can be used to generate data required for the queries

  1. Generating seeds (remember to use same scale factor as your database -s) ./Debug/dbgen -v -O s -s 10
  2. Data generation ./Debug/dbgen -v -U 2 -s 10
  3. Copy the generated files into tpc_h_data folder
  4. Edit the SQL syntax in the tpc_h_htap_qgen.py based on your database type (SQL Server is already provided)
  5. Edit the input and output folder paths if needed.
  6. Run tpc_h_htap_qgen.py

What to update?

Picking the rows that need to be updated can depend on the application. In this implementation we use delete_id list to pick the IDs that need to get updated. However, you can simply change this to whatever you need.

tpc_h_htap's People

Contributors

malingaperera avatar

Stargazers

Tanzid Sultan avatar  avatar

Watchers

 avatar James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.