Comments (4)
keoren3
commented on July 18, 2024
If anyone encounters this, I was able to create a simple workaround.
I created a Python job that checks which agents are offline (Via Jenkins's API), and creates a list of EC2 Id's.
Then it sends a terminate command to AWS to terminate those instance ID's.
Once the instances are terminated the EC2 fleet is able to raise new ones, and doesn't get stuck with dead instances.
This jobs runs on a very small agent, every 5 minutes.
from ec2-fleet-plugin.
oneumyvakin
commented on July 18, 2024
Looks like we also got into this issue.
from ec2-fleet-plugin.
pdk27
commented on July 18, 2024
@keoren3 @oneumyvakin Can you upgrade to the ec2-fleet-2.7.1 and update the issue with logs? The recent versions include some changes related to plugin initiated terminations and I am hoping the logs can help us troubleshoot your issue.
Here are the reasons why the plugin would terminate an instance today. If the terminated instance was idle and the plugin missed terminating it, then this particular issue is fixed. See related issue for explanation.
from ec2-fleet-plugin.
pdk27
commented on July 18, 2024
This issue might be fixed. Closing due to lack of recent activity. Please re-open if the issue still exists.
from ec2-fleet-plugin.
Related Issues (20)
- Minimum Cluster Size = 0 will not spawn any agent HOT 20
- Build node workspace permissions
- Unable to set label on node caused by NullPointerException HOT 1
- Update constructor to follow CasC best practices
- Scale-in Protection always enable HOT 3
- 3.10.0 does not assume role from credentials
- Upgrading 3.0.1 to 3.1.0 deleted cloud configuration HOT 11
- Complete removal of data about the Executors structure 3.0.2 --> 3.1.0 HOT 2
- NoDelayProvisionStrategy won't provision after scaling down to 0 instances in auto scaling group HOT 10
- Cloud is null for computer unknown HOT 1
- EC2 Fleet label based cloud cannot create node
- EC2 ASG agents are not assgined to Jenkins fleet tags - Error during fleet '<fleet_name>' stats update java.lang.NullPointerException HOT 10
- Protected From Scale In HOT 4
- Instance are not shutting down due to "Protection from scale In" HOT 4
- Waiting for next available executor on ‘test i-123456789 HOT 4
- jenkins connect with ipv6 HOT 1
- jenkins connect with ipv6
- EC2 Fleet with AutoScaling Group receives scale-down request prematurely HOT 1
- jnlp connection?
- Agent root directories cannot be on different drives other than C: when using Windows
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ec2-fleet-plugin.