googlecloudplatform / appengine-custom-runtimes-samples Goto Github PK

Samples for creating custom runtimes on Google App Engine Flexible

License: Apache License 2.0

HTML 11.24% Ruby 29.49% Perl 2.30% Swift 9.40% Elixir 11.84% Dockerfile 35.72%

samples

appengine-custom-runtimes-samples's Introduction

Google App Engine Custom Runtime Samples

These are samples for creating custom runtimes on Google App Engine Flexible. These samples are typically referenced from the docs.

See our other Google Cloud Platform github repos for sample applications and scaffolding for other frameworks and use cases.

Deploying

Some samples in this repositories may have special deployment instructions. Refer to the readme in the sample directory.

Use the Google Developers Console to create a project/app id. (App id and project id are identical)

Configure gcloud with your app id.

gcloud config set project <your-app-id>

Use gcloud to deploy your app.
```
gcloud app deploy
```
Congratulations! Your application is now live at your-app-id.appspot.com

Contributing changes

See CONTRIBUTING.md

Licensing

See LICENSE

appengine-custom-runtimes-samples's People

Contributors

Stargazers

Watchers

Forkers

jtietema fewtrell justinbeckwith tmatsuo enterstudio c4rlo pristap odekopoon lsimkins dsignr awestbro ncsuwebdev jeffallen-google danihodovic direkshan-digital johan-lejdung smetsboris dkuspawono svoimoy harinduliyanage martingebhardt saleh-sedighi-ck djalmabright jnibrahim rogeliodavid domesticmouse jorge0136 terfex smart-over taintern creeram aeenra jona7o theo-huang shoustongxm ngfk timtech4u jjdharmaraj trygu robbiealixsantos jochasinga sobanak rjnpnigrhi vankeerrobin suraj790 luttapy dilipsikder123 ankurraiyani muskanmahajan37 mvilche gfb-47 isabella232 jazzed-edtech oliveirajessica ariestriputranto atadzhan diptanshumittal renovate-bot

appengine-custom-runtimes-samples's Issues

Ruby example fails to start.

latest: digest: sha256:4916f24ae6e371c929207e86cd6de1548c887fe2b1257cabf254e9cad0a3fa0b size: 3038
DONE
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Updating service [derp] (this may take several minutes)...failed.                                                                                                                           
ERROR: (gcloud.app.deploy) Error Response: [4] Your deployment has failed to become healthy in the allotted time and therefore was rolled back. If you believe this was an error, try adjusting the 'app_start_timeout_sec' setting in the 'readiness_check' section.

Does it really work without a CMD in the docker file?

nginx sample doesn't really make a lot of sense

It's more likely someone wants to run erlang or perl or something exotic. Also the sample is broken. Can we use something like this?

https://github.com/JustinBeckwith/appengine-perl/tree/master/mojolicious

I'd make the code change in a PR, but I don't know which docs I'd be breaking.

All examples should be tested and deployed whenever a dependency in GCP is upgraded

When google updates a service in GCP that is a dependency of these or any other official google code samples referenced in google docs, Google should deploy and test these samples as part of the GCP release process.

Seriously.

Its frustrating to try something in official google docs/repos, and not have it work due to the samples being out of date.

(NGINX) App Engine Flexible: Timed out waiting for the app infrastructure to become healthy

On first deploy it's successful, however on consecutive gcloud app deploy I'm getting timeout error.

App Engine Flexible: Timed out waiting for the app infrastructure to become healthy

Log looks like below:

gcloud app deploy --verbosity debug
DEBUG: Running [gcloud.app.deploy] with arguments: [--verbosity: "debug"]
DEBUG: Loading runtimes experiment config from [gs://runtime-builders/experiments.yaml]
INFO: Reading [<googlecloudsdk.api_lib.storage.storage_util.ObjectReference object at 0x10cc66150>]
DEBUG: API endpoint: [https://appengine.googleapis.com/], API version: [v1]
Services to deploy:

descriptor:      [/Users/vananaz/Documents/Fun/spike/gae/appengine-custom-runtimes-samples/nginx/app.yaml]
source:          [/Users/vananaz/Documents/Fun/spike/gae/appengine-custom-runtimes-samples/nginx]
target project:  [webserver-temp]
target service:  [default]
target version:  [20200423t174222]
target url:      [https://webserver-temp.an.r.appspot.com]


Do you want to continue (Y/n)?  

DEBUG: No bucket specified, retrieving default bucket.
DEBUG: Using bucket [gs://staging.webserver-temp.appspot.com].
DEBUG: Service [appengineflex.googleapis.com] is already enabled for project [webserver-temp]
Beginning deployment of service [default]...
INFO: Using Dockerfile found in /Users/vananaz/Documents/Fun/spike/gae/appengine-custom-runtimes-samples/nginx
Building and pushing image for service [default]
INFO: Uploading [/var/folders/8y/8pgrrnks7w1c6pkkthzfgc4w0000gp/T/tmpe99I8k/src.tgz] to [staging.webserver-temp.appspot.com/asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest]
DEBUG: Using builder image: [gcr.io/cloud-builders/docker]
Started cloud build [0b92e3ca-df2a-4a64-8958-a844f11cb179].
DEBUG: GCS logfile url is https://www.googleapis.com/storage/v1/b/staging.webserver-temp.appspot.com/o/log-0b92e3ca-df2a-4a64-8958-a844f11cb179.txt?alt=media
To see logs in the Cloud Console: https://console.cloud.google.com/cloud-build/builds/0b92e3ca-df2a-4a64-8958-a844f11cb179?project=798707910148
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 416 (no new content; keep polling)
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 217 bytes)
---------------------------------------------------------- REMOTE BUILD OUTPUT ----------------------------------------------------------
starting build "0b92e3ca-df2a-4a64-8958-a844f11cb179"

FETCHSOURCE
Fetching storage object: gs://staging.webserver-temp.appspot.com/asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest#1587635025163077
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 416 (no new content; keep polling)
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 387 bytes)
Copying gs://staging.webserver-temp.appspot.com/asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest#1587635025163077...
/ [1 files][  2.0 KiB/  2.0 KiB]                                                
Operation completed over 1 objects/2.0 KiB.                                      
BUILD
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 458 bytes)
Already have image (with digest): gcr.io/cloud-builders/docker
Sending build context to Docker daemon  10.75kB
Step 1/6 : FROM nginx
latest: Pulling from library/nginx
123275d6e508: Pulling fs layer
6cd6a943ce27: Pulling fs layer
a50b5ac4a7fb: Pulling fs layer
a50b5ac4a7fb: Verifying Checksum
a50b5ac4a7fb: Download complete
6cd6a943ce27: Verifying Checksum
6cd6a943ce27: Download complete
123275d6e508: Verifying Checksum
123275d6e508: Download complete
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 280 bytes)
123275d6e508: Pull complete
6cd6a943ce27: Pull complete
a50b5ac4a7fb: Pull complete
Digest: sha256:6b3b6c113f98e901a8b1473dee4c268cf37e93d72bc0a01e57c65b4ab99e58ee
Status: Downloaded newer image for nginx:latest
 ---> e791337790a6
Step 2/6 : COPY nginx.conf /etc/nginx/nginx.conf
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 496 bytes)
 ---> 1f63fbb4ad21
Step 3/6 : RUN mkdir -p /var/log/app_engine
 ---> Running in 7381cf981b18
Removing intermediate container 7381cf981b18
 ---> ba7673c97446
Step 4/6 : RUN mkdir -p /usr/share/nginx/www/_ah &&     echo "healthy" > /usr/share/nginx/www/_ah/health
 ---> Running in 0e918a7fb2f5
Removing intermediate container 0e918a7fb2f5
 ---> 36be7c00ff24
Step 5/6 : ADD www/ /usr/share/nginx/www/
 ---> 1e10670f147f
Step 6/6 : RUN chmod -R a+r /usr/share/nginx/www
 ---> Running in 306f572f458e
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 184 bytes)
Removing intermediate container 306f572f458e
 ---> 93bb919b801a
Successfully built 93bb919b801a
Successfully tagged asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 432 bytes)
PUSH
Pushing asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest
The push refers to repository [asia.gcr.io/webserver-temp/appengine/default.20200423t174222]
a0c4c6da1e3b: Preparing
4d43871201d1: Preparing
bcb2e307b696: Preparing
d4b24d6ec2ee: Preparing
b9df7f27ac9d: Preparing
be91fceb796e: Preparing
919b6770519b: Preparing
b60e5c3bcef2: Preparing
be91fceb796e: Waiting
919b6770519b: Waiting
b60e5c3bcef2: Waiting
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 210 bytes)
d4b24d6ec2ee: Pushed
a0c4c6da1e3b: Pushed
4d43871201d1: Pushed
b9df7f27ac9d: Pushed
bcb2e307b696: Pushed
be91fceb796e: Layer already exists
919b6770519b: Layer already exists
b60e5c3bcef2: Layer already exists
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 416 (no new content; keep polling)
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] not complete. Waiting 1s.
DEBUG: Reading GCS logfile: 206 (read 104 bytes)
latest: digest: sha256:d675af0c78f7bc0419b909b8f7f2e3a127e69eb8f380c3f267b9f4b9b0c1f299 size: 1983
DONE
DEBUG: Operation [operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5] complete. Result: {
    "response": {
        "finishTime": "2020-04-23T09:44:13.623124Z", 
        "status": "SUCCESS", 
        "timeout": "600s", 
        "startTime": "2020-04-23T09:43:47.909171788Z", 
        "artifacts": {
            "images": [
                "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest"
            ]
        }, 
        "logsBucket": "staging.webserver-temp.appspot.com", 
        "results": {
            "buildStepOutputs": [
                ""
            ], 
            "images": [
                {
                    "pushTiming": {
                        "endTime": "2020-04-23T09:44:12.665495385Z", 
                        "startTime": "2020-04-23T09:44:02.666669683Z"
                    }, 
                    "name": "asia.gcr.io/webserver-temp/appengine/default.20200423t174222", 
                    "digest": "sha256:d675af0c78f7bc0419b909b8f7f2e3a127e69eb8f380c3f267b9f4b9b0c1f299"
                }, 
                {
                    "pushTiming": {
                        "endTime": "2020-04-23T09:44:12.665495385Z", 
                        "startTime": "2020-04-23T09:44:02.666669683Z"
                    }, 
                    "name": "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest", 
                    "digest": "sha256:d675af0c78f7bc0419b909b8f7f2e3a127e69eb8f380c3f267b9f4b9b0c1f299"
                }
            ], 
            "buildStepImages": [
                "sha256:eb8329874ddfcb260f282b471c8205e0b9a10f8d42c45efc8ab32221bce43402"
            ]
        }, 
        "createTime": "2020-04-23T09:43:46.272869811Z", 
        "@type": "type.googleapis.com/google.devtools.cloudbuild.v1.Build", 
        "timing": {
            "PUSH": {
                "endTime": "2020-04-23T09:44:12.665530010Z", 
                "startTime": "2020-04-23T09:44:02.666668973Z"
            }, 
            "FETCHSOURCE": {
                "endTime": "2020-04-23T09:43:53.173427222Z", 
                "startTime": "2020-04-23T09:43:48.640393941Z"
            }, 
            "BUILD": {
                "endTime": "2020-04-23T09:44:02.666618578Z", 
                "startTime": "2020-04-23T09:43:53.173475060Z"
            }
        }, 
        "source": {
            "storageSource": {
                "object": "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest", 
                "bucket": "staging.webserver-temp.appspot.com"
            }
        }, 
        "options": {
            "logging": "LEGACY"
        }, 
        "steps": [
            {
                "status": "SUCCESS", 
                "pullTiming": {
                    "endTime": "2020-04-23T09:43:54.028497946Z", 
                    "startTime": "2020-04-23T09:43:54.021079877Z"
                }, 
                "timing": {
                    "endTime": "2020-04-23T09:44:02.599569302Z", 
                    "startTime": "2020-04-23T09:43:54.021079877Z"
                }, 
                "args": [
                    "build", 
                    "-t", 
                    "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest", 
                    "."
                ], 
                "name": "gcr.io/cloud-builders/docker"
            }
        ], 
        "sourceProvenance": {
            "resolvedStorageSource": {
                "generation": "1587635025163077", 
                "object": "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest", 
                "bucket": "staging.webserver-temp.appspot.com"
            }, 
            "fileHashes": {
                "gs://staging.webserver-temp.appspot.com/asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest#1587635025163077": {}
            }
        }, 
        "projectId": "webserver-temp", 
        "images": [
            "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest"
        ], 
        "id": "0b92e3ca-df2a-4a64-8958-a844f11cb179", 
        "logUrl": "https://console.cloud.google.com/cloud-build/builds/0b92e3ca-df2a-4a64-8958-a844f11cb179?project=798707910148"
    }, 
    "done": true, 
    "name": "operations/build/webserver-temp/MGI5MmUzY2EtZGYyYS00YTY0LTg5NTgtYTg0NGYxMWNiMTc5", 
    "metadata": {
        "@type": "type.googleapis.com/google.devtools.cloudbuild.v1.BuildOperationMetadata", 
        "build": {
            "finishTime": "2020-04-23T09:44:13.623124Z", 
            "status": "SUCCESS", 
            "timeout": "600s", 
            "startTime": "2020-04-23T09:43:47.909171788Z", 
            "artifacts": {
                "images": [
                    "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest"
                ]
            }, 
            "logsBucket": "staging.webserver-temp.appspot.com", 
            "results": {
                "buildStepOutputs": [
                    ""
                ], 
                "images": [
                    {
                        "pushTiming": {
                            "endTime": "2020-04-23T09:44:12.665495385Z", 
                            "startTime": "2020-04-23T09:44:02.666669683Z"
                        }, 
                        "name": "asia.gcr.io/webserver-temp/appengine/default.20200423t174222", 
                        "digest": "sha256:d675af0c78f7bc0419b909b8f7f2e3a127e69eb8f380c3f267b9f4b9b0c1f299"
                    }, 
                    {
                        "pushTiming": {
                            "endTime": "2020-04-23T09:44:12.665495385Z", 
                            "startTime": "2020-04-23T09:44:02.666669683Z"
                        }, 
                        "name": "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest", 
                        "digest": "sha256:d675af0c78f7bc0419b909b8f7f2e3a127e69eb8f380c3f267b9f4b9b0c1f299"
                    }
                ], 
                "buildStepImages": [
                    "sha256:eb8329874ddfcb260f282b471c8205e0b9a10f8d42c45efc8ab32221bce43402"
                ]
            }, 
            "id": "0b92e3ca-df2a-4a64-8958-a844f11cb179", 
            "timing": {
                "PUSH": {
                    "endTime": "2020-04-23T09:44:12.665530010Z", 
                    "startTime": "2020-04-23T09:44:02.666668973Z"
                }, 
                "FETCHSOURCE": {
                    "endTime": "2020-04-23T09:43:53.173427222Z", 
                    "startTime": "2020-04-23T09:43:48.640393941Z"
                }, 
                "BUILD": {
                    "endTime": "2020-04-23T09:44:02.666618578Z", 
                    "startTime": "2020-04-23T09:43:53.173475060Z"
                }
            }, 
            "source": {
                "storageSource": {
                    "object": "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest", 
                    "bucket": "staging.webserver-temp.appspot.com"
                }
            }, 
            "options": {
                "logging": "LEGACY"
            }, 
            "steps": [
                {
                    "status": "SUCCESS", 
                    "pullTiming": {
                        "endTime": "2020-04-23T09:43:54.028497946Z", 
                        "startTime": "2020-04-23T09:43:54.021079877Z"
                    }, 
                    "timing": {
                        "endTime": "2020-04-23T09:44:02.599569302Z", 
                        "startTime": "2020-04-23T09:43:54.021079877Z"
                    }, 
                    "args": [
                        "build", 
                        "-t", 
                        "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest", 
                        "."
                    ], 
                    "name": "gcr.io/cloud-builders/docker"
                }
            ], 
            "sourceProvenance": {
                "resolvedStorageSource": {
                    "generation": "1587635025163077", 
                    "object": "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest", 
                    "bucket": "staging.webserver-temp.appspot.com"
                }, 
                "fileHashes": {
                    "gs://staging.webserver-temp.appspot.com/asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest#1587635025163077": {}
                }
            }, 
            "projectId": "webserver-temp", 
            "images": [
                "asia.gcr.io/webserver-temp/appengine/default.20200423t174222:latest"
            ], 
            "createTime": "2020-04-23T09:43:46.272869811Z", 
            "logUrl": "https://console.cloud.google.com/cloud-build/builds/0b92e3ca-df2a-4a64-8958-a844f11cb179?project=798707910148"
        }
    }
}
DEBUG: Reading GCS logfile: 416 (no new content; keep polling)
-----------------------------------------------------------------------------------------------------------------------------------------

DEBUG: Converted YAML to JSON: "{
  "betaSettings": {
    "module_yaml_path": "app.yaml", 
    "vm_runtime": "custom"
  }, 
  "entrypoint": {
    "shell": ""
  }, 
  "env": "flex", 
  "handlers": [
    {
      "script": {
        "scriptPath": "PLACEHOLDER"
      }, 
      "urlRegex": ".*"
    }
  ], 
  "runtime": "vm"
}"
DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶INFO: Refreshing due to a 401 (attempt 1/2)                               
INFO: Refreshing access_token
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠧DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠹DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠛DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠶DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠏DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] not complete. Waiting to retry.
Updating service [default] (this may take several minutes)...⠼DEBUG: Operation [apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4] complete. Result: {
    "metadata": {
        "user": "[email protected]", 
        "target": "apps/webserver-temp/services/default/versions/20200423t174222", 
        "@type": "type.googleapis.com/google.appengine.v1.OperationMetadataV1", 
        "insertTime": "2020-04-23T09:44:15.427Z", 
        "method": "google.appengine.v1.Versions.CreateVersion"
    }, 
    "done": true, 
    "name": "apps/webserver-temp/operations/f9c7a0a0-ede4-46f2-9f3b-6312b0204aa4", 
    "error": {
        "message": "Timed out waiting for the app infrastructure to become healthy.", 
        "code": 4
    }
}
Updating service [default] (this may take several minutes)...failed.                                                                    
DEBUG: (gcloud.app.deploy) Error Response: [4] Timed out waiting for the app infrastructure to become healthy.
Traceback (most recent call last):
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/calliope/cli.py", line 983, in Execute
    resources = calliope_command.Run(cli=self, args=args)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/calliope/backend.py", line 807, in Run
    resources = command_instance.Run(args)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/surface/app/deploy.py", line 110, in Run
    default_strategy=flex_image_build_option_default))
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/command_lib/app/deploy_util.py", line 643, in RunDeploy
    ignore_file=args.ignore_file)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/command_lib/app/deploy_util.py", line 433, in Deploy
    extra_config_settings)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/api_lib/app/appengine_api_client.py", line 208, in DeployService
    poller=done_poller)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/api_lib/app/operations_util.py", line 314, in WaitForOperation
    sleep_ms=retry_interval)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/api_lib/util/waiter.py", line 264, in WaitFor
    sleep_ms, _StatusUpdate)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/api_lib/util/waiter.py", line 326, in PollUntilDone
    sleep_ms=sleep_ms)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/core/util/retry.py", line 229, in RetryOnResult
    if not should_retry(result, state):
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/api_lib/util/waiter.py", line 320, in _IsNotDone
    return not poller.IsDone(operation)
  File "/Users/vananaz/Downloads/google-cloud-sdk/lib/googlecloudsdk/api_lib/app/operations_util.py", line 183, in IsDone
    encoding.MessageToPyValue(operation.error)))
OperationError: Error Response: [4] Timed out waiting for the app infrastructure to become healthy.
ERROR: (gcloud.app.deploy) Error Response: [4] Timed out waiting for the app infrastructure to become healthy.

How to pass environment variables?

If running Docker container requires environment variables, how to pass that envs with gcloud app deploy command? Passing that env_vars inside app.yaml

env_variables:
  env1: value1
  env2: value2
  env3: value3

will not be picked by docker container.

Project status

What is the status of this project? Is the repo abandoned? There are multiple PRs open without any feedback, issues in similar state.

This repo is still actively referenced in google documentation. If this repo is being deprecated can we please reflect that elsewhere?

Ala'a Aldean issam

Eng, Tech, Dev, JORDAN 🇯🇴 AlaaIssam

Long TTFB for App Engine Flexible

Hi all,
I don't know if the Issue is correct here.

I do have problems with GCP App Engine Flexible (without any special nginx.conf). Although the App Engine is auto-scaling I do have randomly (1 out of 10) request having a very long connection / TTFB time.

Debugging is telling me, that the app code itself is performing very well (< 100ms) but TTFB is taking up to > 1s.

Is there any way to optimize this, or what could be the issue?

Perl sample shows Managed VMs, not Google Cloud App Engine Flexible Environment

The "Perl" link at https://cloudplatform.googleblog.com/2017/03/your-favorite-languages-now-on-Google-App-Engine.html points to:

https://github.com/GoogleCloudPlatform/appengine-custom-runtimes-samples/tree/master/perl

Which says:

runtime: custom
vm: true

... which is Managed VMs, not the new Google Cloud App Engine Flexible Environment.

(But the app.yaml in that repo correctly has env: flex)

App Engine Flex + Docker + R +Plumber does not work only when I use 'AI Platform Deep Learning Containers'

I want to serve R model using App Engine. I am following this example R with app engine, but stuck. everything works when I do not use 'AI Platform Deep Learning Containers' ,details below.

Please refer to my code app.yaml

service: caret-custom
runtime: custom
env: flex

readiness_check:
  app_start_timeout_sec: 1800

resources:
  cpu: 1
  memory_gb: 0.5
  disk_size_gb: 10

Dockerfile

FROM gcr.io/deeplearning-platform-release/r-cpu  
#FROM gcr.io/gcer-public/plumber-appengine  <--  code works using this container


RUN R -e "install.packages(c('caret', 'xgboost', 'rjson', 'plumber','googleCloudStorageR','googleAuthR'), repos='http://cran.rstudio.com/')"

WORKDIR /payload/
COPY [".", "./"]

EXPOSE 8080
ENTRYPOINT ["R", "-e", "pr <- plumber::plumb(commandArgs()[4]); pr$run(host='0.0.0.0', port=8080,swagger=TRUE)"]
CMD ["main.R"]

main.R

print("in rest controller program")
#* @get /demoR
get_predict_length <- function(){
      
  dataset <- iris
  
  # create the model
  model <- lm(Petal.Length ~ Petal.Width, data = dataset)
  petal_width = "0.4"
  
  #petal_width = '0.4'
  # convert the input to a number
  petal_width <- as.numeric(petal_width)
  
  #create the prediction data frame
  prediction_data <- data.frame(Petal.Width=petal_width)
  
  # create the prediction
  predict(model,prediction_data)
}

I deploy using 'gcloud app deploy and its fails with below error
ERROR: (gcloud.app.deploy) Error Response: [4] Your deployment has failed to become healthy in the allotted time and therefore was rolled back. If you believe this was an error, try adjusting the 'app_start_timeout_sec' setting in the 'readiness_check' section.

I increased 'app_start_timeout_sec' gradually from 300 to 1800 and now I get below error:
Updating service [caret1-custom] (this may take several minutes)...failed.
ERROR: (gcloud.app.deploy) Operation [apps/my-project-id/operations/7db0da8f-213b-476f-a6ba-9c8102b21cd5] timed out. This operation may still be underway.

Issue:
If I use 'FROM gcr.io/gcer-public/plumber-appengine' in place of google provide container 'gcr.io/deeplearning-platform-release/r-cpu', everything is successful.

Please advice, as I am plan to use google provided containers only.

Ashishsr123

Swift sample does not deploy

Swift tools version 3.1.0 is no longer supported and the app no longer deploys

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.