marcelmay / apache-knox-exporter Goto Github PK

Default to INFO, allow override to DEBUG etc.

Configuring the global JDBC DriverManager login timeout can prevent blocks when fetching a connection.

Happens with Hive sometimes :-(

• Update Prometheus simpleclient to 0.6.0

  • io.prometheus:simpleclient ........................... 0.4.0 -> 0.6.0
  • io.prometheus:simpleclient_hotspot ............. 0.4.0 -> 0.6.0
  • io.prometheus:simpleclient_servlet ................0.4.0 -> 0.6.0

• Update knox-shell to latest Knox 1.2.0 release
  org.apache.knox:gateway-shell: ............................1.0.0 -> 1.2.0

• Update snake snakeyaml to latest 1.23
  org.yaml:snakeyaml .............................................. 1.21 -> 1.23

Knox can have multiple Hive and WebHDFS services.

• Multiple Hive queries (eg for baseline, for more complex scenarios) and jdbc urls
• Multiple WebHDFS status endpoints

Expose config reloads as a counter, so that it is easier to correlate reloads and time series changes.

The exporter exposes currently only its memory settings.
Expose all JVM metrics, especially threads as the exporter relies on parallel executions towards Knox.

Compile scope:

• org.yaml:snakeyaml ................................................ 1.23 -> 1.31
• io.prometheus:simpleclient .................................... 0.6.0 -> 0.10.0
• io.prometheus:simpleclient_hotspot ...................... 0.6.0 -> 0.10.0
• io.prometheus:simpleclient_servlet ........................ 0.6.0 -> 0.10.0
• org.slf4j:slf4j-api .................................................... 1.7.25 -> 1.7.30
• org.slf4j:slf4j-log4j12 ............................................. 1.7.25 -> 1.7.30
• org.eclipse.jetty:jetty-servlet ................................. 8.1.22.v20160922 -> 9.4.36.v20210114

Test scope:

• org.assertj:assertj-core ......................................... 3.12.0 -> 3.19.0
• com.squareup.okhttp3:okhttp ............................... 3.12.1 -> 3.14.9
• junit:junit ................................................................ 4.12 -> 4.13.1
• de.m3y.prometheus.assertj:assertj-prometheus ... 0.2 -> 0.5

E.g. trustStorePassword

As especially hive queries tend to be very slow, try to speed up checks by running these in parallel.

It would be helpful to know the error cause (timeout, auth, http status).

Timeout is currently hard coded. Make it externally configurable.

Hi All,

So I'm trying to run the exporter jar file directly inside my Knox-gateway container, I'm running with this and getting a java
exception.

`$ java -jar knox-exporter-1.0.jar 127.0.0.1 9093 config.yml

Exception in thread "main" java.lang.IllegalArgumentException: Label cannot be null.
at io.prometheus.client.SimpleCollector.labels(SimpleCollector.java:68)
at de.m3y.prometheus.exporter.knox.KnoxCollector.configureActions(KnoxCollector.java:216)
at de.m3y.prometheus.exporter.knox.KnoxCollector.(KnoxCollector.java:80)
at de.m3y.prometheus.exporter.knox.WebServer.configure(WebServer.java:21)
at de.m3y.prometheus.exporter.knox.WebServer.main(WebServer.java:63)
`

ps: I'm fairly new to all this so I'm probably making a mistake somewhere

Auto-reload config upon scrape request if config file modification time changed.