Code Monkey home page Code Monkey logo

lustre_exporter's Introduction

Lustre Metrics Exporter

Continuous Integration

Prometheus exporter for Lustre metrics.

Version Support

Lustre Version Exporter Tag
2.12 v2.1.6

Getting

Clone the repository.

Building

Exporter

For just building the exporter: make build

Building the exporter with code testing, formatting and linting: make

Required for build with code linting: go install github.com/golangci/golangci-lint/cmd/golangci-lint@latest

RPM Package Build

A CentOS7 RPM package can be build by using a

  1. Shell build script in rpm/build.sh
  2. Docker build container, see section below.

Docker - Build Container

Binary Build Container

A Debian container is based on the offical golang:1.17.5-bullseye container image for just providing the binary.

# from repo base dir run
sudo docker build  --tag lustre_exporter -f docker/Dockerfile .
sudo docker run --rm -v $PWD:/cpy -it lustre_exporter

The binary will be available in build/lustre_exporter-X.X.X.

RPM Build Container

A CentOS7 container is based on the official CentOS7 container image for providing the exporter in a RPM package.

# from repo base dir run
sudo docker build -t rpm_dock -f docker/RPM-Dockerfile .
sudo docker run --rm -v $PWD:/rpm -it rpm_dock

The RPM package will be available in build/x86_64/prometheus-lustre-exporter-X.X.X-1.0.el7.x86_64.rpm.

Running

./lustre_exporter <flags>

Flags

  • collector.ost=disabled/core/extended
  • collector.mdt=disabled/core/extended
  • collector.mgs=disabled/core/extended
  • collector.mds=disabled/core/extended
  • collector.client=disabled/core/extended
  • collector.generic=disabled/core/extended
  • collector.lnet=disabled/core/extended
  • collector.health=disabled/core/extended

All above flags default to the value "extended" when no argument is submitted by the user.

Example: ./lustre_exporter --collector.ost=disabled --collector.mdt=core --collector.mgs=extended

The above example will result in a running instance of the Lustre Exporter with the following statuses:

  • collector.ost=disabled
  • collector.mdt=core
  • collector.mgs=extended
  • collector.mds=extended
  • collector.client=extended
  • collector.generic=extended
  • collector.lnet=extended
  • collector.health=extended

Flag Option Detailed Description

  • disabled - Completely disable all metrics for this portion of a source.
  • core - Enable this source, but only for metrics considered to be particularly useful.
  • extended - Enable this source and include all metrics that the Lustre Exporter is aware of within it.

What's exported?

All Lustre procfs and procsys data from all nodes running the Lustre Exporter that we perceive as valuable data is exported or can be added to be exported (we don't have any known major gaps that anyone cares about, so if you see something missing, please file an issue!).

See the issues tab for all known issues.

Exporting LNET Metrics

Since the LNET metrics are currently exported based on the DebugFS it is required to have root priviliges or mount DebugFS to be access by different user.

To export that metrics running the exporter as Systemd service as root user, the default user option prometheus must be changed in the service file.

Troubleshooting

In the event that you encounter issues with specific metrics (especially on versions of Lustre older than 2.12), please try disabling those specific troublesome metrics using the documented collector flags in the 'disabled' or 'core' state. Users have encountered bugs within Lustre where specific sysfs and procfs files miscommunicate their sizes, causing read calls to fail.

Contributing

You are welcome to contribute to the project. Feel free to create an issue, pull request or just start a discussion.

lustre_exporter's People

Contributors

gabrieleiannetti avatar jknedlik avatar roclark avatar mjtrangoni avatar benibr avatar wutz avatar joehandzik avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.