Comments (7)
I've seen the same errors. We have 200 snapshots. I opened a PR (#12) that should help with this. Seems to work so far in my tests. The function is fetching tags for automated snapshots that will never be returned and manual snapshots are being fetched twice.
from aurora-snapshot-tool.
Hi @flosell, how many instances of the tool are you running on the same account?
from aurora-snapshot-tool.
@mrcoronel one instance per account
from aurora-snapshot-tool.
Is there any chance you'd have other tools/scripts hitting the RDS APIs? How many snapshots have you got in that account?
There are a few optimisations that I could make (not too many though), but I won't have much time to implement them until next month.
If you've got a support subscription, perhaps you could open a case so they can help you find out why your calls are being throttled?
from aurora-snapshot-tool.
I don't see anything else hitting the RDS APIs. We were running hourly snapshots for two clusters and seven day retention so about 340 snapshots. After reducing retention to three days we seem to be fine now so I'm guessing it's related to the number of snapshots.
Also seems to affect only the lambda in the source account, not the destination account.
I asked AWS support for some more information on their rate limiting, I'll update once I receive a response.
from aurora-snapshot-tool.
Running over the weekend I didn't get any tag throttling. I did get throttled calling DescribeDBClusterSnapshots which is kind of confusing. It only happened once and was fine when it retired so I'm not worried.
from aurora-snapshot-tool.
just merged the PR... the new version is in the buckets too... thanks for the contribution!
from aurora-snapshot-tool.
Related Issues (20)
- How to check destination settings? HOT 2
- Support for Aurora PostgreSQL? HOT 2
- Incomplete pagination prevents sharing HOT 2
- Including automated snapshots increases run time and cost.
- Patterns match against snapshot instead of cluster
- An error occurred (KMSKeyNotAccessibleFault) when calling the CopyDBClusterSnapshot operation: Specified KMS key [None] does not exist, is not enabled or you do not have permissions to access it. HOT 10
- Unable to copy AWS managed KMS encrypted snapshots between accounts HOT 3
- Need overly permissive policy to avoid KMSKeyNotAccessibleFault HOT 1
- Can you go into detail about why this doesn't work with aurora-postgresql? HOT 2
- Same account, different region HOT 3
- KMS ID or KMS ARN HOT 1
- Snapshot issue HOT 3
- Missing rds:addTagsToResources HOT 1
- Add option to use a different KMS key when sharing HOT 1
- Retention days parameter in the dest account not working as expected
- Parameters: [CodeBucket] must have values HOT 1
- Public bucket access HOT 1
- share encrypted snapshot not copying over to another region and account HOT 5
- Failed to create stack HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aurora-snapshot-tool.