Code Monkey home page Code Monkey logo

silverdb's Introduction

SilverDB

SilverDB is an open source distributed time series database. This includes APIs for storing and querying data, processing and more. The master branch on this repo now represents the original SilverDB.

Features

1、Distributed read and write for time-series data and storage based on boltdb

2、Compression for data types,such as timestamp、float64、Integer、String、Boolean

3、Support metircs and tags retrieval within time range

4、Support the storage of tags index data

5、Support wal log and memory caching

6、Support silverDB node,databasea and table metadata registration based on etcd

State of the project

The SilverDB that is on the master branch is currently in the beta stage. This means that it is still NOT recommended for production usage.。dev-1.0 branch is improving tests、features for storage、write、read.

Notice

SilverDB is a distributed time-series database project that just begin to design and develop , and is still in the initial inclubation stage.

You can develop and debug some features of SilverDB in the local environment,such as storage,read and write。

Building From Source

Prerequisites for building SilverDB:

This project requries Go 1.14 and Go module support

Linux、Mac OS x、Windows

git

protobuf 3.3.0+

etcd 3.4.9

Configure SilverDB

config.yaml

nodeName: "node1"     
nodeId: 1
nodeAddr:
  httpAddr: "127.0.0.1:12345"     #httpd service 
  cluAddr: "127.0.0.1:7947"       
  tcpAddr: "127.0.0.1:12346"      #database serivce 
dataDir: ["/Volumes/info/dev/silver/testdata1/","/Volumes/info/dev/silver/testdata2/"]
indexDir: ["/Volumes/info/dev/silver/index1/"]
wal:
  walDir: "/Volumes/info/dev/silver/wal1/"
  ttl: 1                          #wal flush write data ttl 
  nodeNums: 100                   
  listNums: 500                   
  size: 100                       #wal buffer size 
flush:
  count: 5000                     # buffer flush count 
  ttl: 3
heatbeat:
  timeout: 5
  tick: 5
metastore:
  metaAddr: ["127.0.0.1:2379"]     #ectd server 
  metaPrefix: "/silver/metaData/"  # metadata key 
  nodePrefix: "/sliver/node/"      # siverDB node key  
  timeout: 10            
  heartbeat: 5
discovery:
  timeout: 10
compressed: true                       
compressCount: 50000               # data compress size 
indexed: true

git clone https://github.com/rolls-tech/silverDB.git

cd silverDB

go build node1.go

Documention

The documentation of SilverDB is located on the website: https://zhuanlan.zhihu.com/c_1256552728916017152

silverdb's People

Contributors

taohervor avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.