Code Monkey home page Code Monkey logo

knifefly / tdengine Goto Github PK

View Code? Open in Web Editor NEW

This project forked from taosdata/tdengine

0.0 2.0 1.0 48.34 MB

An open-source big data platform designed and optimized for the Internet of Things (IoT).

Home Page: https://www.taosdata.com

License: GNU Affero General Public License v3.0

CMake 0.30% Shell 5.85% C 53.54% C++ 1.51% Go 1.75% CSS 0.01% HTML 0.03% Java 7.31% Python 27.81% Yacc 0.32% Makefile 0.01% MATLAB 0.06% JavaScript 0.83% C# 0.49% Lua 0.06% Dockerfile 0.01% PHP 0.02% Gnuplot 0.02% Batchfile 0.02% Lex 0.05%

tdengine's Introduction

Build Status Build status Coverage Status CII Best Practices tdengine

TDengine

What is TDengine?

TDengine is an open-sourced big data platform under GNU AGPL v3.0, designed and optimized for the Internet of Things (IoT), Connected Cars, Industrial IoT, and IT Infrastructure and Application Monitoring. Besides the 10x faster time-series database, it provides caching, stream computing, message queuing and other functionalities to reduce the complexity and cost of development and operation.

  • 10x Faster on Insert/Query Speeds: Through the innovative design on storage, on a single-core machine, over 20K requests can be processed, millions of data points can be ingested, and over 10 million data points can be retrieved in a second. It is 10 times faster than other databases.

  • 1/5 Hardware/Cloud Service Costs: Compared with typical big data solutions, less than 1/5 of computing resources are required. Via column-based storage and tuned compression algorithms for different data types, less than 1/10 of storage space is needed.

  • Full Stack for Time-Series Data: By integrating a database with message queuing, caching, and stream computing features together, it is no longer necessary to integrate Kafka/Redis/HBase/Spark or other software. It makes the system architecture much simpler and more robust.

  • Powerful Data Analysis: Whether it is 10 years or one minute ago, data can be queried just by specifying the time range. Data can be aggregated over time, multiple time streams or both. Ad Hoc queries or analyses can be executed via TDengine shell, Python, R or Matlab.

  • Seamless Integration with Other Tools: Telegraf, Grafana, Matlab, R, and other tools can be integrated with TDengine without a line of code. MQTT, OPC, Hadoop, Spark, and many others will be integrated soon.

  • Zero Management, No Learning Curve: It takes only seconds to download, install, and run it successfully; there are no other dependencies. Automatic partitioning on tables or DBs. Standard SQL is used, with C/C++, Python, JDBC, Go and RESTful connectors.

Documentation

For user manual, system design and architecture, engineering blogs, refer to TDengine Documentation(中文版请点击这里) for details. The documentation from our website can also be downloaded locally from documentation/tdenginedocs-en or documentation/tdenginedocs-cn.

Building

At the moment, TDengine only supports building and running on Linux systems. You can choose to install from packages or from the source code. This quick guide is for installation from the source only.

To build TDengine, use CMake 3.5 or higher versions in the project directory.

Install tools

Ubuntu & Debian:

sudo apt-get install -y gcc cmake build-essential git

To compile and package the JDBC driver source code, you should have a Java jdk-8 or higher and Apache Maven 2.7 or higher installed. To install openjdk-8:

sudo apt-get install -y openjdk-8-jdk

To install Apache Maven:

sudo apt-get install -y  maven

Centos 7:

sudo yum install -y gcc gcc-c++ make cmake3 epel-release git
sudo yum remove -y cmake
sudo ln -s /usr/bin/cmake3 /usr/bin/cmake

To install openjdk-8:

sudo yum install -y java-1.8.0-openjdk

To install Apache Maven:

sudo yum install -y maven

Centos 8 & Fedora:

sudo dnf install -y gcc gcc-c++ make cmake epel-release git

To install openjdk-8:

sudo dnf install -y java-1.8.0-openjdk

To install Apache Maven:

sudo dnf install -y maven

Get the source codes

First of all, you may clone the source codes from github:

git clone https://github.com/taosdata/TDengine.git
cd TDengine

The connectors for go & grafana have been moved to separated repositories, so you should run this command in the TDengine directory to install them:

git submodule update --init --recursive

Build TDengine

On Linux platform

mkdir debug && cd debug
cmake .. && cmake --build .

To compile on an ARM processor (aarch64 or aarch32), please add option CPUTYPE as below:

aarch64:

cmake .. -DCPUTYPE=aarch64 && cmake --build .

aarch32:

cmake .. -DCPUTYPE=aarch32 && cmake --build .

On Windows platform

If you use the Visual Studio 2013, please open a command window by executing "cmd.exe". Please specify "x86_amd64" for 64 bits Windows or specify "x86" is for 32 bits Windows when you execute vcvarsall.bat.

mkdir debug && cd debug
"C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\vcvarsall.bat" < x86_amd64 | x86 >
cmake .. -G "NMake Makefiles"
nmake

If you use the Visual Studio 2019, please open a command window by executing "cmd.exe". Please specify "x64" for 64 bits Windows or specify "x86" is for 32 bits Windows when you execute vcvarsall.bat.

mkdir debug && cd debug
"c:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Auxiliary\Build\vcvarsall.bat" < x64 | x86 >
cmake .. -G "NMake Makefiles"
nmake

Or, you can open a command window by clicking Visual Studio 2019 menu "Tools -> Command Line -> Developer Command Prompt" or "Tools -> Command Line -> Developer PowerShell" then execute commands as follows:

mkdir debug && cd debug
cmake .. -G "NMake Makefiles"
nmake

Quick Run

Quick Run

To quickly start a TDengine server after building, run the command below in terminal:

./build/bin/taosd -c test/cfg

In another terminal, use the TDengine shell to connect the server:

./build/bin/taos -c test/cfg

option "-c test/cfg" specifies the system configuration file directory.

Installing

After building successfully, TDengine can be installed by:

make install

Users can find more information about directories installed on the system in the directory and files section. It should be noted that installing from source code does not configure service management for TDengine. Users can also choose to install from packages for it.

To start the service after installation, in a terminal, use:

taosd

Then users can use the TDengine shell to connect the TDengine server. In a terminal, use:

taos

If TDengine shell connects the server successfully, welcome messages and version info are printed. Otherwise, an error message is shown.

Try TDengine

It is easy to run SQL commands from TDengine shell which is the same as other SQL databases.

create database db;
use db;
create table t (ts timestamp, a int);
insert into t values ('2019-07-15 00:00:00', 1);
insert into t values ('2019-07-15 01:00:00', 2);
select * from t;
drop database db;

Developing with TDengine

Official Connectors

TDengine provides abundant developing tools for users to develop on TDengine. Follow the links below to find your desired connectors and relevant documentation.

Third Party Connectors

The TDengine community has also kindly built some of their own connectors! Follow the links below to find the source code for them.

How to run the test cases and how to add a new test case?

TDengine's test framework and all test cases are fully open source. Please refer to this document for how to run test and develop new test case.

TDengine Roadmap

  • Support event-driven stream computing
  • Support user defined functions
  • Support MQTT connection
  • Support OPC connection
  • Support Hadoop, Spark connections
  • Support Tableau and other BI tools

Contribute to TDengine

Please follow the contribution guidelines to contribute to the project.

Join TDengine WeChat Group

Add WeChat “tdengine” to join the group,you can communicate with other users.

tdengine's People

Contributors

guanshengliang avatar hjxilinx avatar hzcheng avatar plum-lihui avatar jtao1735 avatar localvar avatar liuyq-617 avatar sangshuduo avatar xiaopingcs avatar zyyang90 avatar fangpanpan avatar freemine avatar yihaodeng avatar xieyinglin avatar stephenkgu avatar stonet2000 avatar aries-lee1991 avatar maikebing avatar dapan1121 avatar johnnyhou327 avatar boxiaobj avatar shawshank-smile avatar dependabot[bot] avatar huskar-t avatar wangyazhou1313 avatar robotspace avatar songtianyi avatar xrdavies avatar amosbird avatar goldeagle avatar

Watchers

James Cloos avatar  avatar

Forkers

linecomparison

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.