Run Fluent-Bit as a daemonset to collect logs and output them to elasticsearch in a Kubernetes cluster. Fluent-Bit is configured in this example to tail all containers (excluding Fluent-Bit containers) and collect STDERR/STDOUT logs made available at /var/log/containers/*.log by Docker. It also includes a Kubernetes meta-data filter which appends information about the pod which produced the log.

To deploy in a Kubernetes cluster:

kubectl -f create fluent-bit-daemonset-elasticsearch.yaml

Elasticsearch for Kubernetes

Previously we used FluentD as a log collector and are experimenting with this light-weight Fluent-Bit option. More details on our experience to come.