Code Monkey home page Code Monkey logo

kick156 / taier Goto Github PK

View Code? Open in Web Editor NEW

This project forked from dtstack/taier

0.0 0.0 0.0 276.71 MB

Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

Home Page: https://dtstack.github.io/Taier/

License: Apache License 2.0

Shell 0.04% JavaScript 0.28% Java 76.97% Scala 0.67% TypeScript 12.29% CSS 5.57% PLpgSQL 3.67% Dockerfile 0.02% SCSS 0.49% Mustache 0.01%

taier's Introduction

Taier Logo

Taier

A distributed dispatching system

官网 | 官方文档

介绍

Taier 太阿,是**古代十大名剑之一

Taier 是一个开源的分布式 DAG 调度系统,专注不同任务的提交和调度。旨在降低 ETL 开发成本,解决任务之间复杂的依赖关系和提交、调度、运维带来的上手成本

Taier 上进行 ETL 开发,不用关心任务错综复杂的依赖关系与底层的大数据平台的架构实现,将工作的重心更多地聚焦在业务之中

Taier 提供了一个提交、调度、运维、指标信息展示的一站式大数据开发平台

功能

核心功能如下:

  • 分布式扩展
  • 可视化 DAG 配置
  • IDE 式开发平台
  • 自定义扩展任务插件
  • 向导、脚本多种模式
  • 上下游依赖调度
  • 支持实时、离线任务
  • 支持对接不同版本的 Hadoop
  • 支持Flink Standalone
  • 对集群环境 0 侵入
  • 多租户多集群隔离
  • 支持 Kerberos 认证
  • 任务多版本支持
  • 自定义参数替换
  • 集群资源实时监控
  • 数据指标实时获取
  • 任务资源限制

架构

architecture

快速开始

$ wget https://github.com/DTStack/Taier/blob/master/docker-compose.yml
$ docker-compose up -d

main

任务类型

任务类型 文档说明
数据同步 文档
实时采集 文档
Flink SQL 文档
Flink 文档
Spark SQL 文档
Hive SQL 文档
OceanBase SQL 文档
ClickHouse SQL 文档
Doris SQL 文档
Shell 文档
Python 文档
自定义扩展 文档

问题反馈

在使用上有遇到 bug 或者优化点,强烈建议你提 issue 我们将及时修复

联系我们

贡献代码

我该如何贡献?

参考文档

贡献者

License

Taier is under the Apache 2.0 license. See the LICENSE file for details.

taier's People

Contributors

diff-stone avatar dingpengfei avatar dtdazhi avatar flechazow avatar flyysoul avatar ghm02708 avatar hanbeikai avatar hyperleoon avatar jiemotongxue avatar jixiangup avatar kinoxyz1 avatar kongshan-zhuyu avatar liuxingyuuu avatar lousenjay avatar mortalyoung avatar peishengsheng avatar poxiao8 avatar qaq-jun avatar saltingfish avatar shiqiwang0 avatar shlpeng avatar strangexin avatar techfight avatar vainhope avatar wangchuanpoxiao avatar wewoor avatar yyl4ever avatar zekai-li avatar zhangyaodong123 avatar zwight avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.