Comments (9)
Hi @reefland, sorry for the delay, will look at it this week!
from grafana-dashboards-kubernetes.
Hi @reefland,
Thanks for reporting this, I will check on my setup and come back to you.
from grafana-dashboards-kubernetes.
Here's a first fix: 6e3a73f
This should have been done when the labels got dropped from kube-prometheus-stack.
Let me know if this solves the issue.
from grafana-dashboards-kubernetes.
Global Network Utilization looks reasonable now, by Namespace is still bonkers:
from grafana-dashboards-kubernetes.
After re-working my install, this looks different now. I get the per namespace metrics now.
But still puzzled on why the per namespace numbers are way higher than the global numbers. My assumption is this is the difference between local and host networking? Here is the zoomed in version of by Namespaces:
The top 3 are ones that either use Host Networking or talk external to the cluster: ceph is just cluster to cluster member, but uses host networking so I can allow non-cluster computer to use the Rook-Ceph storage if needed. The CSI is using storage to a TrueNAS server and the Monitoring namespace is the only namespace still using that CSI (everything else is using Ceph).
I suspect there is some double counting going on.. the CSI is twice the PVC usage.. the containers virtual adapter and physical adapter? If I look at the underlying query rate(container_network_receive_bytes_total[2m0s])
with just the by namespace part removed, you see the results include multiple network adapters (virtual and physical) and I think this is where the double-counting comes in.
Trying to make the query simpler, I limit it to one namespace and one node of that namespace rate(container_network_receive_bytes_total{namespace="democratic-csi",instance="k3s01"}[2m0s])
. You can see the multiple interfaces being counted:
If I make the global based on container_network_receive_bytes_total
and container_network_transmit_bytes_total
, at least it matches:
So maybe that is the way to do global? 🤷♂️
from grafana-dashboards-kubernetes.
Agree, something is probably counted more than once, and this is probably because of the current label selectors.
Sometimes, we need to narrow the scope, but in this case, I can't filter on the interfaces names because they are subject to change depending on the setup…
I made the benches a long time ago and it seemed correct, so I either missed something, or something changed since then.
I don't have the time to make the measures right now, but will have a look when I can.
from grafana-dashboards-kubernetes.
Blocked @jud336 for spamming issues and commits.
from grafana-dashboards-kubernetes.
Because the device
names can be anything, It's not a good idea to filter on them, but I tried to exclude common virtual patterns to make the panels slightly more clear (we could build upon that).
Check out the latest version that sum by device
, and let me know what you think.
Commit: 3e71721
from grafana-dashboards-kubernetes.
Closing
from grafana-dashboards-kubernetes.
Related Issues (20)
- [enhancement] Add support for monitoring node runtime & system resource usage HOT 5
- [bug] node dashboard only shows latest instance HOT 2
- [bug] "CoreDNS - Forward request duration" broken? HOT 5
- suggest lower cardinality variables for the pod dashboard[bug] HOT 3
- Publish tag to make update automation possible HOT 4
- [bug] node dashboard shows no values HOT 7
- [bug] Fix node_* metrics on k8s-views-global.json HOT 3
- [bug] difficult to understand what is missing HOT 6
- [bug] kubernetes-views-namespaces: created_by_name doesn't work HOT 4
- getting Failed to upgrade legacy queries e.replace is not a function HOT 2
- [bug] Pod memory / cpu requests and limits invalid values with Opencost installed HOT 4
- [enhancement] Windows support HOT 16
- [bug] CPU dashboard can report negative values HOT 35
- All dashboards with cluster variable is broken in VictoriaMetrics [bug] HOT 6
- [bug] exclude iowait, steal, idle from CPU uages HOT 2
- [bug] should use last non-null value, rather than mean HOT 3
- The pod view should allow multi-selection (+`all`) for the `namespace` and `pod` variables [enhancement] HOT 3
- [bug] Trivy Dashboard Templating Failed to upgrade legacy queries Datasource prometheus was not found HOT 2
- Question: How I should export dashboard json HOT 3
- [bug] created_by variable is not refreshed on Time Range Change HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from grafana-dashboards-kubernetes.