Comments (16)
Per bucket? Per path?
Costs we think of are:
- storage at rest
- bandwidth delivered (likely the larger of the two)
Figure out bucket structure that makes sense for us from a billing perspective
GCR doesn't give us this breakdown, but maybe GCS does
Use test data? Simulated load?
from k8s.io.
from k8s.io.
Status quo
from k8s.io.
Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale
.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close
.
Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale
from k8s.io.
/lifecycle frozen
/remove-lifecycle stale
/remove-lifecycle rotten
from k8s.io.
Just to document some status here:
We are starting to upload some artifacts, so we are starting to see some GCS costs. However these costs are likely going to be much smaller than the transfer costs once we start serving binaries. I added a page to the billing report that just breaks down GCS by project, which actually lines up pretty closely for now and shows that the numbers aren't that big. We might just not need this report.
Once we get some data transfer going, then I have a tool to build a report for S3 transfers, so I can probably do something similar for GCS.
from k8s.io.
Would be interested in seeing the data. Not super important but may give visibility into what images are high traffic etc.
from k8s.io.
We tried turning this on a while back and had to turn it off for reasons I can't recall. May be able to turn it on again soon?
from k8s.io.
/assign @hh
since you had expressed interest in working on this
from k8s.io.
@cncf legal should have an updated @ii Contract soon to included the appropriate PII clauses.
I'll pick this up once we have that signed, and can add our team to the appropriate google group + perms.
@spiffxp does the appropriate group with perms exist yet or should we work on that as a pair/debug session to ensure principal of least privilege.
from k8s.io.
We likely have work to do.
#1726 might help in putting together the right role
But identifying the right resources to apply it to may take some time. I'm pretty slammed but I'll see if I can find some time next week too follow up with you off PR
from k8s.io.
/assign @Riaankl
from k8s.io.
I think this is no longer blocked, given that @Riaankl has been doing analysis of images transferred from k8s.gcr.io
from k8s.io.
/milestone v1.23
from k8s.io.
Mildly related: #2710 attempts to figure out where images are going
Not necessarily how much each is costing us
from k8s.io.
/milestone clear
from k8s.io.
Related Issues (20)
- Kubeadm v1.24 installation failed on Red Hat-based distributions (CentOS7) using the new package repositories hosted at pkgs.k8s.io HOT 6
- aws-load-balancer-controller CI job failing
- Set up AWS Security Hub HOT 4
- etcd-io Infra and CI Migration HOT 12
- Blocked from APT repository by CloudFront HOT 12
- Access Issue in aws-iam-authenticator e2e tests HOT 4
- Deploy a new nginx instance to handle apt.kubernetes.io and yum.kubernetes.io HOT 4
- Investigate AWS 5k Node e2e Scale costs HOT 19
- Release.key URL redirect causes problem with Cloud Init and gpg HOT 8
- Add a `go.k8s.io` redirect for contact information HOT 13
- Incident with GCP billing HOT 5
- N2 Quota changes for Scale Projects HOT 3
- OIDC Provider Count Affecting EFS CSI Driver Test Cluster Provisioning
- AWS: Pod got deleted unexpectedly HOT 13
- VPC Limit Reached in AWS account eks-e2e-boskos-005 HOT 5
- DNS REQUEST: <your-dns-record> HOT 2
- registry.k8s.io: Unauthenticated requests do not have permission for europe-west10 HOT 4
- `Quota 'CPUS' exceeded` error on containerd presubmits HOT 7
- Cluster API Infra Provider AWS (CAPA) e2e tests regularly because the maximum number of EventBridge Rules has been reached HOT 8
- k8s-infra-prow-build: Deploy KubeCost and integrate it with the existing KubeCost installation on EKS HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from k8s.io.