Code Monkey home page Code Monkey logo

hec-log-shipper's Introduction

HEC Log Shipper

A connector to send arbitrary log sources to remote/local Humio instance.

Installation

  • Download all files in a new folder on a linux node
  • install.sh will install the tool with required configs
  • Verify if logshipper service is running : systemctl status logshipper
  • Stop the service, if its already running : systemctl stop logshipper
  • Update the logshipper.service file in case using logshipper.py instead of logshipper executable

Add sourcetype stanzas for ingestion

  • Update logshipper.conf
  • Stop and start the logshipper service : systemctl stop logshipper; systemctl start logshipper
  • Check logshipper.log for more info
  • loshipper service will not start unless there is one valid stanza in config file Check Humio marketplace to download respective packages

Available Sourcetypes and suggested parsers

(Check Humio marketplace to download respective packages)

  • CrowdStrike FDR
  • CrowdStrike SIEM Connector
  • Syslog
    • it supports both JSON and standard syslog format
    • it will add hostname and source file name to each event
    • use parseJson() to parse the json fields and then use suitable syslog parser as each event will be ingested as json event
  • AWS CloudTrail
  • Amazon GuardDuty
  • GCP Audit Logs

hec-log-shipper's People

Contributors

jshcodes avatar musayev-io avatar nkhetia31 avatar ckachigian avatar redhatrises avatar jlangdev avatar lgtm-migrator avatar shawndwells avatar kylesmartin avatar isimluk avatar

Stargazers

 avatar Drew avatar  avatar Wil How avatar

Watchers

James Cloos avatar  avatar Ray avatar Daniela Remogna avatar  avatar  avatar cjenow avatar  avatar  avatar

hec-log-shipper's Issues

status=203/EXEC

I can't seem to get the service to run. I keep running into code=exited, status=203/EXEC.

GCP Audit Logs Repetitive PubSub Message

Hi,

I'm new to the GitHub community. I'm trying to use the HEC-Log-Shipper to send GCP logs to Humio. I've configured to Google PubSub topic and subscription and run the HEC-Log-Shipper from Ubuntu machine. We're getting logs into Humio. However, once we start the service, we're getting thousands of copies of 1 particular log only. In Google console, I confirmed that the subscriber is pulling messages fine using the pull message in the console. Does anyone face the same issue with GCP audit logs?

I'm sorry if this is not the correct channel to seek for help.

Tried shipper behind proxy does not work

Tried below setup , there is no effect of global proxy parameter. looks like script need to be updated to use proxy server in middle.
[shipper]===> [proxy]========>[AWS]

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.