Comments (3)
Your usecase is for the Compactor to compact blocks created after 72h, correct? Based on your expectation, I think you should set max-time
rather than min-time
.
min-time
is to compact blocks created within than a time window.
from thanos.
Hi @yeya24 ,
Thanks for your answer.
Actually, I'm currently working on a setup where I intend to retain only raw data for the first 30 days and then use the compactor to downgrade the data. I envisioned the following configuration for this purpose:
thanos-compactor:
image: quay.io/thanos/thanos:v0.30.2
depends_on:
- minio
volumes:
- ./bucket/:/etc/thanos/
command:
- 'compact'
- '--log.level=debug'
- '--data-dir=/data'
- '--objstore.config-file=/etc/thanos/bucket.yaml'
- '--wait'
- '--compact.progress-interval=5m'
- '--retention.resolution-1h=365d'
- '--retention.resolution-5m=90d'
- '--retention.resolution-raw=30d'
- '--min-time=29d'
For now, I'm just testing if the --min-time
parameter works as expected.
According to the thanos documentation :
--min-time=0000-01-01T00:00:00Z
Start of time range limit to compact.
Thanos Compactor will compact only blocks, which
happened later than this value. Option can be a
constant time in RFC3339 format or time duration
relative to current time, such as -1d or 2h45m.
Valid duration units are ms, s, m, h, d, w, y.
It appears I may have misunderstood the purpose of this parameter. To clarify, does "later" in this context imply a range from the current time up to 72 hours ago? If this interpretation is correct, why aren't my newer blocks (those younger than 72 hours) being compacted from 2-hour blocks to 4-hour/8-hour blocks, etc.?
Here a screenshot of my bucket blocks :
from thanos.
@yeya24 ,
I tried to move from --min-time=72h
to --max-time=-3d
and it works fine ! Thanks a lot for your help.
I close this issue.
from thanos.
Related Issues (20)
- Thanos ruler vs. eventual consistency of metrics
- Can Huawei's OBS storage be supported? HOT 1
- Thanos React-app : Proxy server for thanos-query
- Query: update of endpoint failed...context deadline exceeded
- Thanos Chart 0.34.0 app version 12.23.1
- Thanos receive fails "no space left on device"
- sidecar: Greatly increased Thanos sidecar memory usage from 0.32.2 to 0.32.3, still exists in 0.35.0 HOT 3
- api/v1/label returns wrong values HOT 3
- Regression in thanos v0.35.1 HOT 3
- Thanos Receiver: Router/Ingestor setup no longer returns `thanos_receive_write_timeseries_*` and `thanos_receive_write_samples_*` metrics with thanos v0.35.1 HOT 3
- Extend Thanos bucket rewrite to support filtered archiving of existing blocks
- Support additional aggregates for downsampling
- Store Announced LabelSets Unexpected
- Warning in Grafana 11+: Thanos Receive dashboard depends on Angular
- compactor: Thanos Compactor compaction level number being set to 93+ for 1 half of HA Prometheus (S3 Storage) HOT 3
- Query: Network bandwidth usage upward of 500MB/s between Querier and configured stores HOT 13
- Codespace doesn't seem to be working
- AWS S3 objectstorage is not working for ap-south-2 region inspite of endpoint and region is mentioned and getting default to dualstack endpoint of us-east-1 HOT 7
- Thanos receive running on ext4 FS experiencing compaction failures HOT 10
- query: If i choose time window shorter than 6 months, i don't see downsampled metrics HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from thanos.