Code Monkey home page Code Monkey logo

tardis's Introduction

1. Setting for running environment


1.1 Requirements

Our Cluster install Apache Spark 2.1.1. and Hadoop-2.7.3. If you need to run it in other Spark version, just update the spark version in build.sbt file of source code and recompile it.

1.2 Building

The code has been writen in Scala and compiled in SBT.

1.3 Configuration & Usage

1.3.1 Application Configure

Make a directory: mkdir ./etc and put the config.conf file under it. Change the configure in config.conf file.

  • rw** : parameters generate raw time series;
  • idx** : parameters generate TARDIS index;
  • cl** : parameters create ground truth for KNN query;
  • eq** : parameters control the exact match query and KNN query;

1.3.2 Run code:

Before running program:

  1. create etc directory and put config.conf file under etc.
  2. create log directory.
  3. put spark-defaults.conf under the directory or use the default spark program configuration.

~/spark/bin/spark-submit --class org.apache.spark.edu.wpi.dsrg.tardis.TARDIS --properties-file ./spark-defaults.conf tardis_2.11-1.0.jar -h

  • -h : display help information;
  • -g : generate raw time series;
  • -b : build index;
  • -c knn : create ground truth for knn query;
  • -q : run time series similarly query;

eqQueryType = exact: exact matching query, knn: kNN-Approximate query eqKnnType = 0: target node access, 1: one partition access, 2: multi partitions access

1.3.3 Cluster Configure

Change cluster application configure in the spark-defaults.conf
For whole cluster environment, consult your cluster administer. The configure file should be stored under hadoop/etc/hadoop/ and spark/conf directories.

1.3.4 Download

Fairness of Usage

If you use our program or code, please reference this paper in your paper as

Liang Zhang, Noura Alghamdi, Mohamed Y. Eltabakh, Elke A. Rundensteiner. TARDIS: Distributed Indexing Framework for Big Time Series Data. Proceedings of 35th IEEE International Conference on Data Engineering ICDE, 2019.

tardis's People

Contributors

lzhang6 avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.