Code Monkey home page Code Monkey logo

job-center's Introduction

job-center

Build Status

概述

job-center设计初衷为任务调度、触发、管控的平台,job-center以go语言包方式的方式加载, 将job的入口方法传递给job-center编译成二进制程序执行,job-center在一个二进制程序内部代理job对外吐 的消息,并根据消息触发响应方法,消息按照严重等级划分为5个等级,对应触发的5种监控方法;在二进制程序的外部 job-center向etcd注册信息,并通过etcd完成job服务治理与调度。

job的触发机制:

每个job都有计时器,皆可以固定时间间隔进行周期运行,job可由多种方式触发,如restapi发送开关信息、etcd,rpc等消息触发 可通过etcd改变job配置信息,设置周期参数。

特点

job-center可以通过go语言定义复杂的job,适合完成定期、多触发的任务模型,如CICD任务、爬虫程序的执行、大数据的定期计算、人工智能的算法训练等等,配合 容器云进行高并发处理事务。

局限性

由于golang语言为静态语言,因此必须要进行编译执行,当然业务写成动态脚本语言,如python、js等,通过本地文件搜索,或者etcd等系统 和job-center进行job日志的监控触发,可进行这一机制的探索,让job-center具备动态化

job-center's People

Contributors

koko990 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.