Hi,
Could you please add LICENSE file and put the copyright holder and license inside each file?

This way there is no chance of someone stumbling across a piece of code without being exposed to the license.

Thanks!

Implement functions to export models and enable online prediction using JSON input data.

Reference
https://cloud.google.com/ml-engine/docs/online-predict

Allow Cloud Functions to support multiple language runtimes

• • Node.js 6 (deprecated)
• • Node.js 8
• • Node.js 10 (Beta)
• • Go

Reference:

• https://cloud.google.com/functions/docs/concepts/exec
• https://cloud.google.com/sdk/gcloud/reference/functions/deploy#--runtime

Update Google libraries to newest versions and test if all code is properly running.

Replace googleapiclient library with dataproc python package in dataproc module.

Reference
https://googleapis.dev/python/dataproc/latest/index.html

There are a lot of lint errors in files.

Run

make lint

We need to fix these lint issues to CI stay green: https://travis-ci.org/globocom/gcloud-utils

Create package to create, deploy and execute Google Cloud Functions.

Reference
https://cloud.google.com/functions/docs/

Add GCloud logging and adjust our logs to use it.

Reference
https://googleapis.dev/python/logging/latest/index.html

https://github.com/globocom/gcloud-utils/blob/master/gcloud_utils/storage.py#L83

When uploading a path that has subpaths, it puts all files in the same path on google storage

Now we have an issue with Storage and Compute Engine coverage.

Actually, Storage is with 43% of coverage and Compute Engine is with 0%.

This issue should be solved when both stay with more than 80% of coverage.

Description

Add to existing documentation the cloud functions package section

Files

• /docs folder
  • index.rst

Remember to use helpful labels and milestones. If you use the "help wanted" label, Code for America will promote it widely.

Now we currently support some services from Google:

• Compute
• Data Proc
• ML Engine
• Storage
• BigQuery

We should support from AWS these similar:

• Compute as EC2
• Data Proc as EMR
• ML Engine as SageMaker
• Storage as S3
• BigQuery as Athena

Stale bot Warns and then closes issues and PRs that have had no activity for a specified amount of time.

How it works

• After a period of inactivity, a label will be applied to mark an issue as stale, and optionally a comment will be posted to notify contributors that the Issue or Pull Request will be closed.

• If the Issue or Pull Request is updated, or anyone comments, then the stale label is removed and nothing further is done until it becomes stale again.

• If no more activity occurs, the Issue or Pull Request will be automatically closed with an optional comment.

Will be helpful to manage the workflow later on.
I want to work on this

Remember to use helpful labels and milestones. If you use the "help wanted" label, Code for America will promote it widely.

Implement unit tests to cloud functions

• Tests
  • Function deploy
  • Execute
  • List functions
  • Describe functions
  • Already Existing function (on create)

Description

googleapiclient.errors.UnknownApiNameOrVersion: name: cloudfunctions version: v1beta2
API needs to be upgraded to just 'v1'

To Reproduce

Try to create a Functions object...

Tasks

• Update to v1 Here

Description

The issue is that gcs_to_table isn't working properly. At the line 68 it is said that the write disposition policy is WRITE_TRUNCATE, so it should overwrite the old table when it exists.

Files

./cli/gcs_to_table
./gcloud_utils/bigquery/bigquery.py

To Reproduce

1 - Use gcs_to_table to create a new table on bigquery with a file on GCS.
2 - Do step 1 again and the error will happen.

Fix code to remove deprecation warnings:
gcloud-utils/gcloud_utils/dataproc.py:24: DeprecationWarning: invalid escape sequence \W self.__pattern = re.compile('[\W_]+') virtualenvs/gcloud-utils/lib/python3.7/site-packages/google/protobuf/descriptor.py:47: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated, and in 3.8 it will stop working from google.protobuf.pyext import _message virtualenvs/gcloud-utils/lib/python3.7/site-packages/google/cloud/iam.py:38: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated, and in 3.8 it will stop working class Policy(collections.MutableMapping)