This article describes how to monitor Fluentd via Prometheus. Since both Prometheus and Fluentd are under CNCF (Cloud Native Computing Foundation), Fluentd project is recommending to use Prometheus by default to monitor Fluentd. https://docs.fluentd.org/monitoring-fluentd/monitoring-prometheus
The configmap and daemonset below are located on this github repo.
kubectl apply -f fluentd-cm.yaml # please review the changes to make sure all the metrics and configurations in there
kubectl apply -f fluentd-ds.yaml # please update with your image name- Exec into fluentd deamonset pod and run the curl command http://:24231/metrics and you should see the prometheus metrics
kubectl get pods -n kube-system -o wide
kubectl exec fluentd-k4jrm -it bash -n kube-system
apt update && sudo apt upgrade
apt install curl
root@fluentd-g9m57:/home/fluent# curl http://10.240.0.20:24231/metrics # Please use your fluentd pod IP address
TYPE fluentd_input_log_count counter
HELP fluentd_input_log_count The total number of incoming records
fluentd_input_log_count{tag="fml.model_logs",hostname="fluentd-g9m57",worker="0"} 1958.0- If above step successful, under 5 minutes, you should see prometheus metrics under InsightsMetricsTable
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent