Code Monkey home page Code Monkey logo

skyeye's Introduction

SkyEye

对java、scala等运行于jvm的程序进行实时日志采集、索引和可视化,对系统进行进程级别的监控,对系统内部的操作进行策略性的报警、对分布式的rpc调用进行trace跟踪以便于进行性能分析

架构

  • APP: 接入skyeye-client的系统会通过kafkaAppender向kafka写入日志
  • es-indexer-group: kafka的es消费组,读取kafka的数据并批量bulk到es
  • monitor-group: kafka的监控消费组,app在日志中进行各种event埋点(如:第三方异常报警、请求耗时异常报警等)
  • business-group: kafka的业务消费组
  • trace-group: 通过日志进行rpc调用trace跟踪(dapper论文)
  • es: 日志存储db,并建立相关索引
  • zookeeper: app注册中心
  • monitor: 监控中心,监听zookeeper注册中心中相应的节点变化进行监控报警
  • rabbitmq: 监控报警缓冲队列
  • alert: 具体报警手段,包括邮件和微信

部署步骤

修改每个项目中gradle文件的私服地址等其他相关信息 修改每个项目中的properties文件中的配置项(配置文件外部化和内部化都需要修改)

skyeye-base

cd skyeye-base
gradle clean install uploadArchives

skyeye-client

cd skyeye-client
gradle clean install uploadArchives

skyeye-data

cd skyeye-data
gradle clean install uploadArchives

skyeye-trace

cd skyeye-trace
gradle clean install uploadArchives

skyeye-alarm

cd skyeye-alarm
gradle clean distZip -x test
cd target/distributions
unzip skyeye-alarm-x.x.x.zip(替换相应的x为自己的版本)

skyeye-collector

根据对接系统的个数和产生日志的量进行部署,最好部署3个节点(每个节点消费3个partition的数据)

cd skyeye-collector
gradle clean distZip -x test
cd target/distributions
unzip skyeye-collector-x.x.x.zip(替换相应的x为自己的版本)

cd skyeye-collector-x.x.x
nohup bin/skyeye-collector &

skyeye-monitor

cd skyeye-monitor
gradle clean distZip -x test
cd target/distributions
unzip skyeye-monitor-x.x.x.zip(替换相应的x为自己的版本)

cd skyeye-monitor-x.x.x
nohup bin/skyeye-monitor &

skyeye-web

cd skyeye-web
gradle clean distZip -x test
cd target/distributions
unzip skyeye-web-x.x.x.zip(替换相应的x为自己的版本)

cd skyeye-web-x.x.x
nohup bin/skyeye-web &

交流方式

  1. QQ群: 624054633
  2. Email: [email protected]
  3. blog: http://blog.csdn.net/jthink_

skyeye's People

Contributors

jthink avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.