Comments (6)
Sidekiq Pro extends the batch's expiry to the dead job lifetime so the batch will not expire before any dead batch jobs have been garbage collected
Ahh, this makes sense! Maybe updating the Wiki will clear this up. 👍
from sidekiq.
My goal is to clear out these pending batches that we know will not succeed, so that we can get the admin UI back to being useful for looking at newer batches that may be stuck for different reasons.
If you have clear criteria for deleting batches, you can delete them from the Rails console:
Sidekiq::BatchSet.new.select {|b| b.description.match /^Full Title/ }.map(&:delete)
Sidekiq::BatchSet.new.select {|b| b.failures > 1 }.map(&:delete)
Sidekiq::BatchSet.new.detect {|b| b.bid == "S9yJ0GD2CW1TGw"}.delete
from sidekiq.
30 days is the default. The only way I know to change this value is to monkeypatch the Sidekiq::Batch::EXPIRY constant.
from sidekiq.
Batches with failures show in the UI that they expire in 5 months.
![image](https://private-user-images.githubusercontent.com/10649/328589595-aeb9fce6-c805-4edd-a964-625b794fec6f.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTg5Mzg1NjksIm5iZiI6MTcxODkzODI2OSwicGF0aCI6Ii8xMDY0OS8zMjg1ODk1OTUtYWViOWZjZTYtYzgwNS00ZWRkLWE5NjQtNjI1Yjc5NGZlYzZmLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjIxVDAyNTEwOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTcxNDI5Yzg5ZGI4MjBhMTU3OTI4ZDYxZmNmZWQwNThiNzIzMGVlOTA0YWYwOTYyMzdiMDY4YWRlMTFjNzgyMTkmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.9ZEHi-n7UWlPyG2QzaBKT8BrLjAwE5w0bVZ6mKFdEas)
Created at for that batch 2024-05-02 18:19:08 138173/2097152 UTC
.
from sidekiq.
Yup, thanks @raybaxter ours looks just like that as well.
from sidekiq.
This will happen if a batch job dies. Sidekiq Pro extends the batch's expiry to the dead job lifetime so the batch will not expire before any dead batch jobs have been garbage collected. See lib/sidekiq/batch/death.rb
line 75.
from sidekiq.
Related Issues (20)
- Current attributes lost after inline execution HOT 2
- Child batches with enqueued jobs don't prevent parent batches from completing HOT 8
- `sidekiq-pro` gem 7.2.1 not found in the repository HOT 1
- Add splash logo on startup when using a custom log formatter HOT 2
- Job payload inconsistently persisted through retries HOT 3
- delete_by_class returns zero and doesn't remove any jobs HOT 1
- sidekiq-ent not found when running bin/rails on Ruby 3.3.2 HOT 5
- Dependency on the `logger` gem which will be removed in Ruby 3.5 HOT 2
- QUESTION: Is it possible to customize UI? HOT 3
- sidekiq-ent: unknown keyword: :cluster_safe (ArgumentError) HOT 2
- Error with rack 3.1.0 HOT 3
- Language selector in footer hides web body content HOT 1
- Sidekiq Pro 7.2.0 does not support dogstatsd-ruby versions less than v5 HOT 2
- Ghost callbacks spam the retry set? HOT 10
- Nested batches fire in a wrong order in testing mode HOT 5
- Sidekiq API uninitialized when route drawing is deferred HOT 3
- Killing busy job by kill thread issue HOT 1
- Unmet dependency: Redis 6.2.0 doesn't exist HOT 2
- Consolidate metrics under the sidekiq.* namespace
- Is job.delete on a ScheduledSet job a valid way to do it now? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sidekiq.