Code Monkey home page Code Monkey logo

amazon.cloud's Issues

S3 integration tests raise ThrottlingException

Summary

S3 integration tests still raise ThrottlingException even after catching the exception and adding retries.
s3 integration tests have been temporary disabled (see #40) and further investigation is needed.

2023-01-26 11:17:36.781878 \| controller \| TASK [s3 : Delete S3 bucket] ***************************************************
--
12158 | 2023-01-26 11:17:36.781884 \| controller \| task path: /home/zuul/.ansible/collections/ansible_collections/amazon/cloud/tests/integration/targets/s3/tasks/main.yml:242
12159 | 2023-01-26 11:17:45.376705 \| controller \| Using module file /home/zuul/.ansible/collections/ansible_collections/amazon/cloud/plugins/modules/s3_bucket.py
12160 | 2023-01-26 11:17:45.376748 \| controller \| Pipelining is enabled.
12161 | 2023-01-26 11:17:45.376756 \| controller \| <testhost> ESTABLISH LOCAL CONNECTION FOR USER: zuul
12162 | 2023-01-26 11:17:45.376763 \| controller \| <testhost> EXEC /bin/sh -c 'ANSIBLE_DEBUG_BOTOCORE_LOGS=True /home/zuul/venv/bin/python && sleep 0'
12163 | 2023-01-26 11:17:45.376770 \| controller \| The full traceback is:
12164 | 2023-01-26 11:17:45.376776 \| controller \| Traceback (most recent call last):
12165 | 2023-01-26 11:17:45.376784 \| controller \|   File "/tmp/ansible_amazon.cloud.s3_bucket_payload_v4ib8xxx/ansible_amazon.cloud.s3_bucket_payload.zip/ansible_collections/amazon/cloud/plugins/module_utils/core.py", line 195, in list_resource_requests
12166 | 2023-01-26 11:17:45.376790 \| controller \|     response = self.client.list_resource_requests(
12167 | 2023-01-26 11:17:45.376796 \| controller \|   File "/tmp/ansible_amazon.cloud.s3_bucket_payload_v4ib8xxx/ansible_amazon.cloud.s3_bucket_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/retries.py", line 96, in deciding_wrapper
12168 | 2023-01-26 11:17:45.376818 \| controller \|     return retrying_wrapper(*args, **kwargs)
12169 | 2023-01-26 11:17:45.376826 \| controller \|   File "/tmp/ansible_amazon.cloud.s3_bucket_payload_v4ib8xxx/ansible_amazon.cloud.s3_bucket_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/cloud.py", line 115, in _retry_wrapper
12170 | 2023-01-26 11:17:45.376832 \| controller \|     return _retry_func(
12171 | 2023-01-26 11:17:45.376838 \| controller \|   File "/tmp/ansible_amazon.cloud.s3_bucket_payload_v4ib8xxx/ansible_amazon.cloud.s3_bucket_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/cloud.py", line 65, in _retry_func
12172 | 2023-01-26 11:17:45.376844 \| controller \|     return func()
12173 | 2023-01-26 11:17:45.376848 \| controller \|   File "/home/zuul/venv/lib/python3.9/site-packages/botocore/client.py", line 391, in _api_call
12174 | 2023-01-26 11:17:45.376853 \| controller \|     return self._make_api_call(operation_name, kwargs)
12175 | 2023-01-26 11:17:45.376858 \| controller \|   File "/home/zuul/venv/lib/python3.9/site-packages/botocore/client.py", line 719, in _make_api_call
12176 | 2023-01-26 11:17:45.376863 \| controller \|     raise error_class(parsed_response, operation_name)
12177 | 2023-01-26 11:17:45.376868 \| controller \| botocore.errorfactory.ThrottlingException: An error occurred (ThrottlingException) when calling the ListResourceRequests operation (reached max retries: 4): Rate exceeded
12178 | 2023-01-26 11:17:45.376873 \| controller \| fatal: [testhost]: FAILED! => {
12179 | 2023-01-26 11:17:45.376879 \| controller \|     "boto3_version": "1.20.0",
12180 | 2023-01-26 11:17:45.376885 \| controller \|     "botocore_version": "1.23.0",
12181 | 2023-01-26 11:17:45.376890 \| controller \|     "changed": false,
12182 | 2023-01-26 11:17:45.376895 \| controller \|     "error": {
12183 | 2023-01-26 11:17:45.376900 \| controller \|         "code": "ThrottlingException",
12184 | 2023-01-26 11:17:45.376905 \| controller \|         "message": "Rate exceeded"
12185 | 2023-01-26 11:17:45.376910 \| controller \|     },
12186 | 2023-01-26 11:17:45.376915 \| controller \|     "invocation": {
12187 | 2023-01-26 11:17:45.376920 \| controller \|         "module_args": {
12188 | 2023-01-26 11:17:45.376925 \| controller \|             "accelerate_configuration": null,
12189 | 2023-01-26 11:17:45.376930 \| controller \|             "access_control": null,
12190 | 2023-01-26 11:17:45.376936 \| controller \|             "access_key": "ASIA6CCDWXDOKBFP3TXZ",
12191 | 2023-01-26 11:17:45.376940 \| controller \|             "analytics_configurations": null,
12192 | 2023-01-26 11:17:45.376944 \| controller \|             "aws_access_key": "ASIA6CCDWXDOKBFP3TXZ",
12193 | 2023-01-26 11:17:45.376949 \| controller \|             "aws_ca_bundle": null,
12194 | 2023-01-26 11:17:45.376954 \| controller \|             "aws_config": null,
12195 | 2023-01-26 11:17:45.376958 \| controller \|             "aws_secret_key": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
12196 | 2023-01-26 11:17:45.376963 \| controller \|             "bucket_encryption": null,
12197 | 2023-01-26 11:17:45.376967 \| controller \|             "bucket_name": "d8ea0ccd-31dd-548c-aa26-514258b6c748",
12198 | 2023-01-26 11:17:45.376971 \| controller \|             "cors_configuration": null,
12199 | 2023-01-26 11:17:45.376976 \| controller \|             "debug_botocore_endpoint_logs": true,
12200 | 2023-01-26 11:17:45.376980 \| controller \|             "endpoint_url": null,
12201 | 2023-01-26 11:17:45.376984 \| controller \|             "force": false,
12202 | 2023-01-26 11:17:45.377050 \| controller \|             "intelligent_tiering_configurations": null,
12203 | 2023-01-26 11:17:45.377056 \| controller \|             "inventory_configurations": null,
12204 | 2023-01-26 11:17:45.377062 \| controller \|             "lifecycle_configuration": null,
12205 | 2023-01-26 11:17:45.377067 \| controller \|             "logging_configuration": null,
12206 | 2023-01-26 11:17:45.377071 \| controller \|             "metrics_configurations": null,
12207 | 2023-01-26 11:17:45.377076 \| controller \|             "notification_configuration": null,
12208 | 2023-01-26 11:17:45.377080 \| controller \|             "object_lock_configuration": null,
12209 | 2023-01-26 11:17:45.377085 \| controller \|             "object_lock_enabled": null,
12210 | 2023-01-26 11:17:45.377089 \| controller \|             "ownership_controls": null,
12211 | 2023-01-26 11:17:45.377094 \| controller \|             "profile": null,
12212 | 2023-01-26 11:17:45.377098 \| controller \|             "public_access_block_configuration": null,
12213 | 2023-01-26 11:17:45.377103 \| controller \|             "purge_tags": true,
12214 | 2023-01-26 11:17:45.377107 \| controller \|             "region": "us-east-1",
12215 | 2023-01-26 11:17:45.377112 \| controller \|             "replication_configuration": null,
12216 | 2023-01-26 11:17:45.377117 \| controller \|             "secret_key": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
12217 | 2023-01-26 11:17:45.377121 \| controller \|             "security_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
12218 | 2023-01-26 11:17:45.377131 \| controller \|             "session_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
12219 | 2023-01-26 11:17:45.377137 \| controller \|             "state": "absent",
12220 | 2023-01-26 11:17:45.377141 \| controller \|             "tags": null,
12221 | 2023-01-26 11:17:45.377146 \| controller \|             "validate_certs": true,
12222 | 2023-01-26 11:17:45.377151 \| controller \|             "versioning_configuration": null,
12223 | 2023-01-26 11:17:45.377156 \| controller \|             "wait": true,
12224 | 2023-01-26 11:17:45.377160 \| controller \|             "wait_timeout": 320,
12225 | 2023-01-26 11:17:45.377165 \| controller \|             "website_configuration": null
12226 | 2023-01-26 11:17:45.377170 \| controller \|         }
12227 | 2023-01-26 11:17:45.377174 \| controller \|     },
12228 | 2023-01-26 11:17:45.377179 \| controller \|     "msg": "Failed to list resource requests: An error occurred (ThrottlingException) when calling the ListResourceRequests operation (reached max retries: 4): Rate exceeded",
12229 | 2023-01-26 11:17:45.377184 \| controller \|     "resource_actions": [
12230 | 2023-01-26 11:17:45.377189 \| controller \|         "cloudcontrolapi:GetResource",
12231 | 2023-01-26 11:17:45.377193 \| controller \|         "cloudcontrolapi:ListResourceRequests"
12232 | 2023-01-26 11:17:45.377198 \| controller \|     ],
12233 | 2023-01-26 11:17:45.377202 \| controller \|     "response_metadata": {
12234 | 2023-01-26 11:17:45.377207 \| controller \|         "http_headers": {
12235 | 2023-01-26 11:17:45.377211 \| controller \|             "content-length": "88",
12236 | 2023-01-26 11:17:45.377216 \| controller \|             "content-type": "application/x-amz-json-1.0",
12237 | 2023-01-26 11:17:45.377221 \| controller \|             "date": "Thu, 26 Jan 2023 11:17:45 GMT",
12238 | 2023-01-26 11:17:45.377225 \| controller \|             "x-amzn-requestid": "512f6531-4f01-486e-86e9-164d5b59601c"
12239 | 2023-01-26 11:17:45.377230 \| controller \|         },
12240 | 2023-01-26 11:17:45.377234 \| controller \|         "http_status_code": 400,
12241 | 2023-01-26 11:17:45.377239 \| controller \|         "max_attempts_reached": true,
12242 | 2023-01-26 11:17:45.377245 \| controller \|         "request_id": "512f6531-4f01-486e-86e9-164d5b59601c",
12243 | 2023-01-26 11:17:45.377255 \| controller \|         "retry_attempts": 4
12244 | 2023-01-26 11:17:45.377260 \| controller \|     }
12245 | 2023-01-26 11:17:45.377265 \| controller \| }
12246 | 2023-01-26 11:17:45.377270 \| controller \|


2023-01-26 11:17:36.781878 \| controller \| TASK [s3 : Delete S3 bucket] ***************************************************
--
12158 | 2023-01-26 11:17:36.781884 \| controller \| task path: /home/zuul/.ansible/collections/ansible_collections/amazon/cloud/tests/integration/targets/s3/tasks/main.yml:242
12159 | 2023-01-26 11:17:45.376705 \| controller \| Using module file /home/zuul/.ansible/collections/ansible_collections/amazon/cloud/plugins/modules/s3_bucket.py
12160 | 2023-01-26 11:17:45.376748 \| controller \| Pipelining is enabled.
12161 | 2023-01-26 11:17:45.376756 \| controller \| <testhost> ESTABLISH LOCAL CONNECTION FOR USER: zuul
12162 | 2023-01-26 11:17:45.376763 \| controller \| <testhost> EXEC /bin/sh -c 'ANSIBLE_DEBUG_BOTOCORE_LOGS=True /home/zuul/venv/bin/python && sleep 0'
12163 | 2023-01-26 11:17:45.376770 \| controller \| The full traceback is:
12164 | 2023-01-26 11:17:45.376776 \| controller \| Traceback (most recent call last):
12165 | 2023-01-26 11:17:45.376784 \| controller \|   File "/tmp/ansible_amazon.cloud.s3_bucket_payload_v4ib8xxx/ansible_amazon.cloud.s3_bucket_payload.zip/ansible_collections/amazon/cloud/plugins/module_utils/core.py", line 195, in list_resource_requests
12166 | 2023-01-26 11:17:45.376790 \| controller \|     response = self.client.list_resource_requests(
12167 | 2023-01-26 11:17:45.376796 \| controller \|   File "/tmp/ansible_amazon.cloud.s3_bucket_payload_v4ib8xxx/ansible_amazon.cloud.s3_bucket_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/retries.py", line 96, in deciding_wrapper
12168 | 2023-01-26 11:17:45.376818 \| controller \|     return retrying_wrapper(*args, **kwargs)
12169 | 2023-01-26 11:17:45.376826 \| controller \|   File "/tmp/ansible_amazon.cloud.s3_bucket_payload_v4ib8xxx/ansible_amazon.cloud.s3_bucket_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/cloud.py", line 115, in _retry_wrapper
12170 | 2023-01-26 11:17:45.376832 \| controller \|     return _retry_func(
12171 | 2023-01-26 11:17:45.376838 \| controller \|   File "/tmp/ansible_amazon.cloud.s3_bucket_payload_v4ib8xxx/ansible_amazon.cloud.s3_bucket_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/cloud.py", line 65, in _retry_func
12172 | 2023-01-26 11:17:45.376844 \| controller \|     return func()
12173 | 2023-01-26 11:17:45.376848 \| controller \|   File "/home/zuul/venv/lib/python3.9/site-packages/botocore/client.py", line 391, in _api_call
12174 | 2023-01-26 11:17:45.376853 \| controller \|     return self._make_api_call(operation_name, kwargs)
12175 | 2023-01-26 11:17:45.376858 \| controller \|   File "/home/zuul/venv/lib/python3.9/site-packages/botocore/client.py", line 719, in _make_api_call
12176 | 2023-01-26 11:17:45.376863 \| controller \|     raise error_class(parsed_response, operation_name)
12177 | 2023-01-26 11:17:45.376868 \| controller \| botocore.errorfactory.ThrottlingException: An error occurred (ThrottlingException) when calling the ListResourceRequests operation (reached max retries: 4): Rate exceeded
12178 | 2023-01-26 11:17:45.376873 \| controller \| fatal: [testhost]: FAILED! => {
12179 | 2023-01-26 11:17:45.376879 \| controller \|     "boto3_version": "1.20.0",
12180 | 2023-01-26 11:17:45.376885 \| controller \|     "botocore_version": "1.23.0",
12181 | 2023-01-26 11:17:45.376890 \| controller \|     "changed": false,
12182 | 2023-01-26 11:17:45.376895 \| controller \|     "error": {
12183 | 2023-01-26 11:17:45.376900 \| controller \|         "code": "ThrottlingException",
12184 | 2023-01-26 11:17:45.376905 \| controller \|         "message": "Rate exceeded"
12185 | 2023-01-26 11:17:45.376910 \| controller \|     },
12186 | 2023-01-26 11:17:45.376915 \| controller \|     "invocation": {
12187 | 2023-01-26 11:17:45.376920 \| controller \|         "module_args": {
12188 | 2023-01-26 11:17:45.376925 \| controller \|             "accelerate_configuration": null,
12189 | 2023-01-26 11:17:45.376930 \| controller \|             "access_control": null,
12190 | 2023-01-26 11:17:45.376936 \| controller \|             "access_key": "ASIA6CCDWXDOKBFP3TXZ",
12191 | 2023-01-26 11:17:45.376940 \| controller \|             "analytics_configurations": null,
12192 | 2023-01-26 11:17:45.376944 \| controller \|             "aws_access_key": "ASIA6CCDWXDOKBFP3TXZ",
12193 | 2023-01-26 11:17:45.376949 \| controller \|             "aws_ca_bundle": null,
12194 | 2023-01-26 11:17:45.376954 \| controller \|             "aws_config": null,
12195 | 2023-01-26 11:17:45.376958 \| controller \|             "aws_secret_key": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
12196 | 2023-01-26 11:17:45.376963 \| controller \|             "bucket_encryption": null,
12197 | 2023-01-26 11:17:45.376967 \| controller \|             "bucket_name": "d8ea0ccd-31dd-548c-aa26-514258b6c748",
12198 | 2023-01-26 11:17:45.376971 \| controller \|             "cors_configuration": null,
12199 | 2023-01-26 11:17:45.376976 \| controller \|             "debug_botocore_endpoint_logs": true,
12200 | 2023-01-26 11:17:45.376980 \| controller \|             "endpoint_url": null,
12201 | 2023-01-26 11:17:45.376984 \| controller \|             "force": false,
12202 | 2023-01-26 11:17:45.377050 \| controller \|             "intelligent_tiering_configurations": null,
12203 | 2023-01-26 11:17:45.377056 \| controller \|             "inventory_configurations": null,
12204 | 2023-01-26 11:17:45.377062 \| controller \|             "lifecycle_configuration": null,
12205 | 2023-01-26 11:17:45.377067 \| controller \|             "logging_configuration": null,
12206 | 2023-01-26 11:17:45.377071 \| controller \|             "metrics_configurations": null,
12207 | 2023-01-26 11:17:45.377076 \| controller \|             "notification_configuration": null,
12208 | 2023-01-26 11:17:45.377080 \| controller \|             "object_lock_configuration": null,
12209 | 2023-01-26 11:17:45.377085 \| controller \|             "object_lock_enabled": null,
12210 | 2023-01-26 11:17:45.377089 \| controller \|             "ownership_controls": null,
12211 | 2023-01-26 11:17:45.377094 \| controller \|             "profile": null,
12212 | 2023-01-26 11:17:45.377098 \| controller \|             "public_access_block_configuration": null,
12213 | 2023-01-26 11:17:45.377103 \| controller \|             "purge_tags": true,
12214 | 2023-01-26 11:17:45.377107 \| controller \|             "region": "us-east-1",
12215 | 2023-01-26 11:17:45.377112 \| controller \|             "replication_configuration": null,
12216 | 2023-01-26 11:17:45.377117 \| controller \|             "secret_key": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
12217 | 2023-01-26 11:17:45.377121 \| controller \|             "security_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
12218 | 2023-01-26 11:17:45.377131 \| controller \|             "session_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
12219 | 2023-01-26 11:17:45.377137 \| controller \|             "state": "absent",
12220 | 2023-01-26 11:17:45.377141 \| controller \|             "tags": null,
12221 | 2023-01-26 11:17:45.377146 \| controller \|             "validate_certs": true,
12222 | 2023-01-26 11:17:45.377151 \| controller \|             "versioning_configuration": null,
12223 | 2023-01-26 11:17:45.377156 \| controller \|             "wait": true,
12224 | 2023-01-26 11:17:45.377160 \| controller \|             "wait_timeout": 320,
12225 | 2023-01-26 11:17:45.377165 \| controller \|             "website_configuration": null
12226 | 2023-01-26 11:17:45.377170 \| controller \|         }
12227 | 2023-01-26 11:17:45.377174 \| controller \|     },
12228 | 2023-01-26 11:17:45.377179 \| controller \|     "msg": "Failed to list resource requests: An error occurred (ThrottlingException) when calling the ListResourceRequests operation (reached max retries: 4): Rate exceeded",
12229 | 2023-01-26 11:17:45.377184 \| controller \|     "resource_actions": [
12230 | 2023-01-26 11:17:45.377189 \| controller \|         "cloudcontrolapi:GetResource",
12231 | 2023-01-26 11:17:45.377193 \| controller \|         "cloudcontrolapi:ListResourceRequests"
12232 | 2023-01-26 11:17:45.377198 \| controller \|     ],
12233 | 2023-01-26 11:17:45.377202 \| controller \|     "response_metadata": {
12234 | 2023-01-26 11:17:45.377207 \| controller \|         "http_headers": {
12235 | 2023-01-26 11:17:45.377211 \| controller \|             "content-length": "88",
12236 | 2023-01-26 11:17:45.377216 \| controller \|             "content-type": "application/x-amz-json-1.0",
12237 | 2023-01-26 11:17:45.377221 \| controller \|             "date": "Thu, 26 Jan 2023 11:17:45 GMT",
12238 | 2023-01-26 11:17:45.377225 \| controller \|             "x-amzn-requestid": "512f6531-4f01-486e-86e9-164d5b59601c"
12239 | 2023-01-26 11:17:45.377230 \| controller \|         },
12240 | 2023-01-26 11:17:45.377234 \| controller \|         "http_status_code": 400,
12241 | 2023-01-26 11:17:45.377239 \| controller \|         "max_attempts_reached": true,
12242 | 2023-01-26 11:17:45.377245 \| controller \|         "request_id": "512f6531-4f01-486e-86e9-164d5b59601c",
12243 | 2023-01-26 11:17:45.377255 \| controller \|         "retry_attempts": 4
12244 | 2023-01-26 11:17:45.377260 \| controller \|     }
12245 | 2023-01-26 11:17:45.377265 \| controller \| }
12246 | 2023-01-26 11:17:45.377270 \| controller \|


Issue Type

Bug Report

Component Name

s3_bucket

Ansible Version

$ ansible --version

Collection Versions

$ ansible-galaxy collection list

AWS SDK versions

$ pip show boto3 botocore

Configuration

$ ansible-config dump --only-changed

OS / Environment

No response

Steps to Reproduce

Expected Results

Tests pass without any error.

Actual Results

Code of Conduct

  • I agree to follow the Ansible Code of Conduct

memorydb integration tests are disabled

Summary

memorydb integration tests has been disabled in https://github.com/ansible-collections/amazon.cloud/pull/110/files because they are missing policies right now.

A PR adding the needed policies has already been created mattclay/aws-terminator#291

Issue Type

Bug Report

Component Name

memorydb integration tests

Ansible Version

$ ansible --version

ansible [core 2.15.0]

Collection Versions

$ ansible-galaxy collection list

AWS SDK versions

$ pip show boto3 botocore

Name: boto3
Version: 1.25.0

Name: botocore
Version: 1.31.17

Configuration

$ ansible-config dump --only-changed

OS / Environment

No response

Steps to Reproduce

ansible-test integration memorydb

Expected Results

Integration tests succeeding.

Actual Results

Code of Conduct

  • I agree to follow the Ansible Code of Conduct

modules missing examples

Summary

Someone pointed out that the modules/plugins don't have examples listed.

Issue Type

Documentation Report

Component Name

autoscaling_launch_configuration.py

Ansible Version

$ ansible --version

Collection Versions

$ ansible-galaxy collection list

Configuration

$ ansible-config dump --only-changed

OS / Environment

No response

Additional Information

No response

Code of Conduct

  • I agree to follow the Ansible Code of Conduct

Ansible Contributor Summit. Tuesday, April 12, 2022.

Ansible Contributor Summit

We are happy to announce that the registration for the Ansible Contributor Summit is open!

Why
  • This is a great opportunity for interested people to meet, discuss related topics, share their stories and opinions, get the latest important updates and just to hang out together.

  • There will be different announcements & presentations by Community, Core, Cloud, Network, and other teams.

  • Current contributors will be happy to share their stories and experience with newcomers.

  • There will be links to interactive self-passed instruqt scenarios shared during the event that help newcomers learn different aspects of development.

Where/when

Online on Matrix and Youtube. Tuesday, April 12, 2022, 12:00 - 20:00 UTC.

How to join
  • Add the event to your calendar. Use the ical URL (for example, in Google Calendar "Add other calendars" > "Import from URL") instead of importing the .ics file so that any updates to the event will be reflected in your calendar.

  • Check out the Summit page:

    • Add you name to attendees.
    • Suggest summit topics that would be interesting to you to hear about.
    • Vote on and propose changes to topics suggested by others.
    • If you want to be a presenter, please contact the Ansible Community team via [email protected].

We are looking forward to seeing you!:)

MemoryDB support

Summary

I'm acutally working on the MemoryDB and the purpose of this issue is to have a place to keep track of the process.

Issue Type

Feature Idea

Component Name

  • memorydb_acl
  • memorydb_cluster
  • memorydb_parameter_group
  • memorydb_subnet_group
  • memorydb_user

Additional Information

No response

Code of Conduct

  • I agree to follow the Ansible Code of Conduct

iam tests fail with: "not authorized to perform: iam:UploadServerCertificate"

Summary

The error:

2022-12-08 02:25:32.429814 | controller | TASK [iam : Create Certificate with Chain and path] ****************************
2022-12-08 02:25:32.429818 | controller | task path: /home/zuul/.ansible/collections/ansible_collections/amazon/cloud/tests/integration/targets/iam/tasks/main.yml:160
2022-12-08 02:25:43.771469 | controller | File lookup using /var/tmp/ansible.ot9fr89g.test/cert2-key.pem as file
2022-12-08 02:25:43.771521 | controller | Using module file /home/zuul/.ansible/collections/ansible_collections/amazon/cloud/plugins/modules/iam_server_certificate.py
2022-12-08 02:25:43.771530 | controller | Pipelining is enabled.
2022-12-08 02:25:43.771537 | controller | <testhost> ESTABLISH LOCAL CONNECTION FOR USER: zuul
2022-12-08 02:25:43.771543 | controller | <testhost> EXEC /bin/sh -c 'ANSIBLE_DEBUG_BOTOCORE_LOGS=True /home/zuul/venv/bin/python && sleep 0'
2022-12-08 02:25:43.771550 | controller | The full traceback is:
2022-12-08 02:25:43.771556 | controller | Traceback (most recent call last):
2022-12-08 02:25:43.771563 | controller |   File "/tmp/ansible_amazon.cloud.iam_server_certificate_payload_57w2imqa/ansible_amazon.cloud.iam_server_certificate_payload.zip/ansible_collections/amazon/cloud/plugins/module_utils/core.py", line 260, in present
2022-12-08 02:25:43.771571 | controller |     resource = self.client.get_resource(
2022-12-08 02:25:43.771584 | controller |   File "/tmp/ansible_amazon.cloud.iam_server_certificate_payload_57w2imqa/ansible_amazon.cloud.iam_server_certificate_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/retries.py", line 96, in deciding_wrapper
2022-12-08 02:25:43.771602 | controller |     return retrying_wrapper(*args, **kwargs)
2022-12-08 02:25:43.771612 | controller |   File "/tmp/ansible_amazon.cloud.iam_server_certificate_payload_57w2imqa/ansible_amazon.cloud.iam_server_certificate_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/cloud.py", line 115, in _retry_wrapper
2022-12-08 02:25:43.771617 | controller |     return _retry_func(
2022-12-08 02:25:43.771622 | controller |   File "/tmp/ansible_amazon.cloud.iam_server_certificate_payload_57w2imqa/ansible_amazon.cloud.iam_server_certificate_payload.zip/ansible_collections/amazon/aws/plugins/module_utils/cloud.py", line 65, in _retry_func
2022-12-08 02:25:43.771628 | controller |     return func()
2022-12-08 02:25:43.771633 | controller |   File "/home/zuul/venv/lib/python3.9/site-packages/botocore/client.py", line 391, in _api_call
2022-12-08 02:25:43.771641 | controller |     return self._make_api_call(operation_name, kwargs)
2022-12-08 02:25:43.771646 | controller |   File "/home/zuul/venv/lib/python3.9/site-packages/botocore/client.py", line 719, in _make_api_call
2022-12-08 02:25:43.771651 | controller |     raise error_class(parsed_response, operation_name)
2022-12-08 02:25:43.771657 | controller | botocore.errorfactory.ResourceNotFoundException: An error occurred (ResourceNotFoundException) when calling the GetResource operation: AWS::IAM::ServerCertificate Handler returned status FAILED: The Server Certificate with name ansible-test-96259f54ff99 cannot be found. (Service: Iam, Status Code: 404, Request ID: c41d4165-6b94-422b-b7e6-6d67531dd0c1) (HandlerErrorCode: NotFound, RequestToken: 8c89a8a3-72a1-4660-8938-b20acec52efd)
2022-12-08 02:25:43.771663 | controller |
2022-12-08 02:25:43.771669 | controller | During handling of the above exception, another exception occurred:
2022-12-08 02:25:43.771674 | controller |
2022-12-08 02:25:43.771679 | controller | Traceback (most recent call last):
2022-12-08 02:25:43.771684 | controller |   File "/tmp/ansible_amazon.cloud.iam_server_certificate_payload_57w2imqa/ansible_amazon.cloud.iam_server_certificate_payload.zip/ansible_collections/amazon/cloud/plugins/module_utils/core.py", line 98, in wait_until_resource_request_success
2022-12-08 02:25:43.771689 | controller |     get_waiter(self.client, "resource_request_success").wait(
2022-12-08 02:25:43.771694 | controller |   File "/home/zuul/venv/lib/python3.9/site-packages/botocore/waiter.py", line 350, in wait
2022-12-08 02:25:43.771698 | controller |     raise WaiterError(
2022-12-08 02:25:43.771703 | controller | botocore.exceptions.WaiterError: Waiter resource_request_success failed: Waiter encountered a terminal failure state: For expression "ProgressEvent.OperationStatus" we matched expected path: "FAILED"
2022-12-08 02:25:43.771709 | controller | fatal: [testhost]: FAILED! => {
2022-12-08 02:25:43.771714 | controller |     "boto3_version": "1.20.0",
2022-12-08 02:25:43.771718 | controller |     "botocore_version": "1.23.0",
2022-12-08 02:25:43.771722 | controller |     "changed": false,
2022-12-08 02:25:43.771727 | controller |     "invocation": {
2022-12-08 02:25:43.771732 | controller |         "module_args": {
2022-12-08 02:25:43.771737 | controller |             "access_key": "ASIA6CCDWXDOFQY7PL5X",
2022-12-08 02:25:43.771741 | controller |             "aws_access_key": "ASIA6CCDWXDOFQY7PL5X",
2022-12-08 02:25:43.771746 | controller |             "aws_ca_bundle": null,
2022-12-08 02:25:43.771750 | controller |             "aws_config": null,
2022-12-08 02:25:43.771755 | controller |             "aws_secret_key": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
2022-12-08 02:25:43.771761 | controller |             "certificate_body": "-----BEGIN CERTIFICATE-----\nMIIDNzCCAh+gAwIBAgIUM+dvgd8i7EXYdAHxV7o54ZIkrCwwDQYJKoZIhvcNAQEL\nBQAwHTEbMBkGA1UEAwwSY2VydDEuYW5zaWJsZS50ZXN0MB4XDTIyMTIwODAyMjQw\nOFoXDTMyMTIwNTAyMjQwOFowHTEbMBkGA1UEAwwSY2VydDIuYW5zaWJsZS50ZXN0\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAw9X6qWeextqD8EEhNdme\nB4eZqdbnFAmXmE/P62BRwXOSorquxJlf7bLUVBVmopmUaiUj+Z7iGrXAt52NqqCy\nvX/GHs0ZK4xhTcL8w4maKk+XmwlsSUxYIeCTONxgguunbZyeZNYn1K4P9wmYIvLW\niIifV7Sz3cZErgltMkrcIkRoxBdE9HGMXMwab7QTelYpAG9+CS6KCs3VtBwnk+D+\ny3s07Ar0dB+xY9cK31EgJbtGu+8CKK60c3lx13NhmP4F4z0oi+rmvf1ARnJ46BoP\nRApH4jcsY49fh0HmoyeeBMY+IDVyzCGGSPi9qGlzr/WPvZw9iNfoZ+PJQllKT7VI\nxwIDAQABo28wbTAdBgNVHREEFjAUghJjZXJ0Mi5hbnNpYmxlLnRlc3QwDAYDVR0T\nBAUwAwEB/zAdBgNVHQ4EFgQU5tc9utWUTbBrBzo4grJ3VM3K3UswHwYDVR0jBBgw\nFoAUYhUcgr0J3jqvG8uJKvrYdCe+p0kwDQYJKoZIhvcNAQELBQADggEBAIHrIHWa\nWeo+XFhxz+epMnKyAIxQrDYtIJpnS+0ddLjJsW+hqADwF1sUJdOqncMlMxoCtsHC\nu9xDJq/4dTpRv2HC3GXhDXB4POiqYB0ep3yvVfFI94bkNiPMB5JjPANM3C9GcDBm\neh63ms50kF4GAKnkLLyfV+Utv2iePld09gjwh7QaEeZc5yKmZIUGuTY3ExJZ8XAW\nyzXiOD+9ENI9lWUyMUFAY6Cuw8f1QAO47plfF/Wov+GChJJISZwegkgPKGCFY07R\nKBph5oUzmRxP/DAiayJ7QpAOERLV4ohYQbRpUBiJanM3aP+Y8UyAU4fGtbQFIti+\n/sumU2+9RnOuwYo=\n-----END CERTIFICATE-----",
2022-12-08 02:25:43.771775 | controller |             "certificate_chain": "-----BEGIN CERTIFICATE-----\nMIIDNDCCAhygAwIBAgIUFACt24zyMcm55fuTKfhix3c2eIEwDQYJKoZIhvcNAQEL\nBQAwGjEYMBYGA1UEAwwPY2EuYW5zaWJsZS50ZXN0MB4XDTIyMTIwODAyMjQwN1oX\nDTMyMTIwNTAyMjQwN1owHTEbMBkGA1UEAwwSY2VydDEuYW5zaWJsZS50ZXN0MIIB\nIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAqDWQp8vaICatZkP3rw1pZcJA\nxWxg0pv+asXegvD3W72ya6y1FRm8zeqzlN36f2Lzw2zAmchrKa5ssbTC1tlylyyI\nPmd2bxheX9V+r0uizPzVsLUloWpGc9xNTVEy310t3cg4sLr0l1STykubQ+Y+gFmX\n7bNCqZYM22LKWE4cyKJbrOO0IOU2sgfgCgcmJxsBVzzxpZOsvNx4lwuItcOsaUsF\nk0TZaXngyioa5tm8yK6G/r5idzR9Sy5egvs6ymqLr5QUCfNDJu8rbqYA4yLPfQYX\nHs4dN16qUX6lG7m3kYuCKu2JODW1ifozi1isxObWm+IRH6xTFFejW6hhXju0RwID\nAQABo28wbTAdBgNVHREEFjAUghJjZXJ0MS5hbnNpYmxlLnRlc3QwDAYDVR0TBAUw\nAwEB/zAdBgNVHQ4EFgQUYhUcgr0J3jqvG8uJKvrYdCe+p0kwHwYDVR0jBBgwFoAU\nIqQ1vZMEz1XqZblDBIZFOwjK7Z8wDQYJKoZIhvcNAQELBQADggEBAIB8FtW3ld5C\nbAFGWwFmcRik6Enbfe5sowZuHJG3WqR4nIr/Oaeiv1nTGMvHiO6JX1E+REX83j0A\nU7jtLN1SPyRILWcZCoZWjQGCC8H9QgIHW4vd509OqY/yPeBwe5QFmCjogzUJG6Rk\n4Q++yj74HL2v7WREFKy1rCvhtFRo0MX8qde3jJ5kRi2goSAJ2cdn+hw7sIsiHsBF\nADKpNKzTWX2q/e5obERxxYEBFXVQtApAbt3gQaggCfK492nAWSIJcpHhnYAKy43M\neWSQZHsxSaDd5T5m9dmNhGKivAjThQLNKDuhBWgJV+hpIPyUCqZPkiHsZlW8QieB\nUrFpp0M/XHE=\n-----END CERTIFICATE-----",
2022-12-08 02:25:43.771780 | controller |             "debug_botocore_endpoint_logs": true,
2022-12-08 02:25:43.771785 | controller |             "endpoint_url": null,
2022-12-08 02:25:43.771789 | controller |             "force": false,
2022-12-08 02:25:43.771794 | controller |             "path": "/example/",
2022-12-08 02:25:43.771799 | controller |             "private_key": "-----BEGIN RSA PRIVATE KEY-----\nMIIEpQIBAAKCAQEAw9X6qWeextqD8EEhNdmeB4eZqdbnFAmXmE/P62BRwXOSorqu\nxJlf7bLUVBVmopmUaiUj+Z7iGrXAt52NqqCyvX/GHs0ZK4xhTcL8w4maKk+Xmwls\nSUxYIeCTONxgguunbZyeZNYn1K4P9wmYIvLWiIifV7Sz3cZErgltMkrcIkRoxBdE\n9HGMXMwab7QTelYpAG9+CS6KCs3VtBwnk+D+y3s07Ar0dB+xY9cK31EgJbtGu+8C\nKK60c3lx13NhmP4F4z0oi+rmvf1ARnJ46BoPRApH4jcsY49fh0HmoyeeBMY+IDVy\nzCGGSPi9qGlzr/WPvZw9iNfoZ+PJQllKT7VIxwIDAQABAoIBAFgPWLMjXqDBcrGu\nv73EuMxe+8iE04zNkWbSgMaxHaI1E3tsIZlS9HFgyBx1MR0tnTCrucUN3lMvZlTK\nmoDe2PDgS1jfVhGggsKiSuGsdu/OsXfsIU7GbxzwrJLVeep1B+kAk7L5H5kBmjk2\nDbytYK2tbaVVIso3VPvDTmBejCU1vvdbGIumpaRh3PdTXoXGvXQZ7b4Ap2NDal/c\nwBmAQR5yc4/vJa58EOXHkuuKRHGaeqIJA15IqMXNO2pjOaROQfNxVbHqvTnJ0cHA\n2fJVKUUHD/mGsAHCFLQu+hGVGq1gWat5qF9Jwy0JxW1QfkIzo9N+mqgWTY9zkdXZ\nwS23Df0CgYEA0jCvU9tgRiFUZUSt/RozS/SaX+oWSPoK12JBfB2PuRM5qsdtUwrw\nIenDb9NZnqQPq9Y3Q8SJN+f6dzRReMQt3XMUDbkKDQJlXGVZJ5Kd3d5vTLXF7qMb\nflL273J7kzqnPpj/yLeyLNZdeVJT0+CDIT27sfPWPndbeS64pgnwu9sCgYEA7oRp\nbHw0ocv7zpxJHx4gSkXe+oyL/cbv+Ap/nixd45uMpH3VTdzu0DWAh5C13y3TGAhe\nY/8gLIefIKeVUvNmlm0Zq9UwixgNbbJ0EYorp8bRcaZXLP2jbrDNIO0Rlx5gJCQM\ns9BjkN0LNirH3ePRmwgwYIGUGBVhobVnXBWSEIUCgYEAiVhWuKz409qjkyi1qFWe\nf1tuJI6J0VXSD7ucnsWSTJVLcVSvEzxqfT6K/l9UiF0cAGUR565dG7Lx70K4mflX\nHwU7bVwkPSv7n8x53Wnozjmy8KU2mSDrrjf4M67TIPmKn1TKjxW5z6KjocsyC5kB\nFo+IPlfe/yJvG1h0P8rvC1ECgYEArMc6Xx2yOqo7JDXOOj5mgacPmUuKdTFQz8s7\nGudks+YQAXAtvhOW4zh+fLV1KdBWJAib56/+LIOp38vFvasX20v41qK+YWPxBk/J\nCJOggA7j1YH7kFnDtAFa9skEfwW/+y4qDW+dUGjvIDPpSHEpezZ5ZM846iFC8hMo\nZmoxvskCgYEAr8biqFMGgstK1znNrKiiJm5br/eINMH/t7McT2sAas8ZHmI2ftDB\n7jB69ZEx0LNfG/4Fcy9mNmbLeAcr6sejUJCJ8EAb+sFCz0pMGrEXTl5xYpeRV7tj\nbCc0BQb/xho25bigeJBCdSoaGxYmldZga9SCoZLg9NQft3+OAJDiTFg=\n-----END RSA PRIVATE KEY-----",
2022-12-08 02:25:43.771804 | controller |             "profile": null,
2022-12-08 02:25:43.771809 | controller |             "purge_tags": true,
2022-12-08 02:25:43.771814 | controller |             "region": "us-east-1",
2022-12-08 02:25:43.771818 | controller |             "secret_key": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
2022-12-08 02:25:43.771823 | controller |             "security_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
2022-12-08 02:25:43.771830 | controller |             "server_certificate_name": "ansible-test-96259f54ff99",
2022-12-08 02:25:43.771834 | controller |             "session_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
2022-12-08 02:25:43.771839 | controller |             "state": "present",
2022-12-08 02:25:43.771843 | controller |             "tags": null,
2022-12-08 02:25:43.771848 | controller |             "validate_certs": true,
2022-12-08 02:25:43.771853 | controller |             "wait": false,
2022-12-08 02:25:43.771857 | controller |             "wait_timeout": 320
2022-12-08 02:25:43.771862 | controller |         }
2022-12-08 02:25:43.771866 | controller |     },
2022-12-08 02:25:43.771871 | controller |     "msg": "Resource request failed to reach successful state: User: arn:aws:sts::966509639900:assumed-role/ansible-core-ci-test-prod/prod=remote=zuul-cloud is not authorized to perform: iam:UploadServerCertificate on resource: arn:aws:iam::966509639900:server-certificate/example/ansible-test-96259f54ff99 because no identity-based policy allows the iam:UploadServerCertificate action (Service: Iam, Status Code: 403, Request ID: 7329c667-e030-4948-b84b-f72eb76c104b)",
2022-12-08 02:25:43.771876 | controller |     "resource_actions": [
2022-12-08 02:25:43.771882 | controller |         "cloudcontrolapi:GetResource",
2022-12-08 02:25:43.771887 | controller |         "cloudcontrolapi:CreateResource",
2022-12-08 02:25:43.771891 | controller |         "cloudcontrolapi:GetResourceRequestStatus"
2022-12-08 02:25:43.771896 | controller |     ]
2022-12-08 02:25:43.771901 | controller | }

Issue Type

CI Bug Report

CI Jobs

https://a371b139c14986d71a7a-f8d8ccb59dea8cc5da7180eb1eb9230c.ssl.cf1.rackcdn.com/31/ab51d64dee931698ffc6935cfe46c9832cb17ebd/check/ansible-test-integration-amazon-cloud/1b374e1/job-output.txt

Pull Request

#31

Additional Information

Code of Conduct

  • I agree to follow the Ansible Code of Conduct

Include localhost and playbook examples

Summary

From an internal JIRA ticket:

add example Ansible Playbooks where we talk about localhost and how cloud modules work. At the very least we should link back to the AWS guide and make it clear "where" to start.

NOTE: The AWS guide is associated with the amazon.aws collection. You could add a link to it from the readme. Also that guide may need to be updated if it needs to reflect this collection as well.

Issue Type

Documentation Report

Component Name

collection-level docs

Ansible Version

$ ansible --version

Collection Versions

$ ansible-galaxy collection list

Configuration

$ ansible-config dump --only-changed

OS / Environment

No response

Additional Information

No response

Code of Conduct

  • I agree to follow the Ansible Code of Conduct

How to create the contents of the config directory (modules.yaml and api_specification)

Summary

I would like to understand how the contents of the config/ directory are created - I understand that they come via CloudFormations, but I was wondering whether they are automatically generated, or whether they are human generated and then ingested at build time? I've tried rebuilding the collection using Content Builder without the api_specification directory, and it only created a very limited number of modules. Can more details on how this directory is created/updated be included in the documentation please?

Issue Type

Documentation Report

Component Name

Content Builder configuraiton

Ansible Version

$ ansible --version

Collection Versions

$ ansible-galaxy collection list

Configuration

$ ansible-config dump --only-changed

OS / Environment

No response

Additional Information

No response

Code of Conduct

  • I agree to follow the Ansible Code of Conduct

Module docs not showing up on galaxyNG

Summary

The collection is present on Galaxy NG, but none of the module documentation is currently showing up:
https://beta-galaxy.ansible.com/ui/repo/published/amazon/cloud/content/module/autoscaling_launch_configuration/

Issue Type

Documentation Report

Component Name

all modules

Ansible Version

$ ansible --version

Collection Versions

$ ansible-galaxy collection list

Configuration

$ ansible-config dump --only-changed

OS / Environment

No response

Additional Information

No response

Code of Conduct

  • I agree to follow the Ansible Code of Conduct

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.