aws-samples / aws-step-functions-ebs-snapshot-mgmt Goto Github PK
View Code? Open in Web Editor NEWExample architecture for integrating AWS Step Functions and Amazon CloudWatch Events.
License: MIT No Attribution
Example architecture for integrating AWS Step Functions and Amazon CloudWatch Events.
License: MIT No Attribution
I was able to create stack using provided template and but when it comes to deploy, getting errors which i am not able to troubleshoot.
Initially, I have tried to create stack using AWS UI which failed due to missing CAPABILITY_IAM attribute. Thought aws cli would solve the missing attribute problem which did actually but then got stuck with different problem.
Please advice how can i correct the attached errors.
Stack error.pdf
how can we use same code to move snapshot to s3
https://github.com/aws-samples/aws-step-functions-ebs-snapshot-mgmt/blob/master/TagSnapshots.js
Line 64
Name: "tag-key"
The alternative syntax can be changed to Name: "tag:key". Then, users can tag their volumes with 'key' and desire value if they would like to specify what volumes should be applied for the solution
Volume tag example:
tag KEY tag VALUE
key [whatever defined in Lambda function or specified when deployed via the CFN]
Then, we can change the value of the tag value to another value to turn off backup copy to DR region. The originally way need to rename the tag key or remove the tag completely in order to turn off.
I'm having this issue copying from us-east-1 (Primary) to us-east-2 (DR) where 6 of 7 of my copies always immediately change to "error"
If I manually copy, it works fine. This same framework works in my other AWS environments going from us-east-2 (Primary) to us-east-1 (DR). I've checked CloudTrail logs and see no messages about anything failing and the AWS Step Function shows it succeeded:
Any suggestions or help would be greatly appreciated.
Hi,
I thought this is a wonderful approach for disaster recovery aspects.
I have implemented this solution to create daily snapshots from our volumes and to copy them across to a different region. (eu-west-1 to eu-central-1)
But if there are a couple of snapshots you run into errors.
While investigating my CloudWatch Logs I found the cause to be:
[ResourceLimitExceeded: Too many snapshot copies in progress. The limit is 5 for this destination region.]
message: 'Too many snapshot copies in progress. The limit is 5 for this destination region.',
Not sure how to resolve this properly. I have asked the support to increase the limit, but a programmatic approach would be best. I think of a SQS to rather queue jobs with lambda as a consumer to copy then snapshots rather sequentially.
Any ideas?
Many thanks
Ralph
Keeps saying undefined here event.detail.source.substring. Not sure what needs to be defined. I've tried substituting with different strings and also defining the source. Using this on GovCloud and Cloudwatch rule to collect CloudTrail snapshot events and invoke the Step Function. Any help is appreciated.
var volumeId = event.detail.source.substring(event.detail.source.indexOf('/') + 1);
var snapshotId = event.detail.snapshot_id.substring(event.detail.snapshot_id.indexOf('/') + 1);
{
"errorType": "TypeError",
"errorMessage": "Cannot read property 'substring' of undefined",
"trace": [
"TypeError: Cannot read property 'substring' of undefined",
" at Runtime.exports.handler (/var/task/TagSnapshots.js: 12:40)",
" at Runtime.handleOnce (/var/runtime/Runtime.js:66:25)"
]
}
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.