Code Monkey home page Code Monkey logo

bigquery-buildkite-plugin's People

Contributors

dependabot[bot] avatar jashparekh avatar natalisucks avatar renovate[bot] avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

Forkers

thummisetti

bigquery-buildkite-plugin's Issues

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Rate-Limited

These updates are currently rate-limited. Click on a checkbox below to force their creation now.

  • Update dependency proto-plus to v1.23.0
  • Update dependency protobuf to v4.25.3
  • Update dependency pyasn1 to v0.6.0
  • Update dependency pyasn1-modules to v0.4.0
  • Update dependency pyparsing to v3.1.2
  • Update dependency pytest to v7.4.4
  • Update dependency pytest-cov to v4.1.0
  • Update dependency pytest-mock to v3.14.0
  • Update dependency python-dateutil to v2.9.0.post0
  • Update dependency typing_extensions to v4.11.0
  • Update actions/checkout action to v4
  • Update actions/setup-python action to v5
  • Update actions/stale action to v9
  • Update actions/upload-artifact action to v4
  • Update codecov/codecov-action action to v4
  • Update dependency flake8 to v7
  • Update dependency mypy to v1
  • Update dependency packaging to v24
  • Update dependency protobuf to v5
  • Update dependency pytest to v8
  • Update dependency pytest-cov to v5
  • ๐Ÿ” Create all rate-limited PRs at once ๐Ÿ”

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

Ignored or Blocked

These are blocked by an existing closed PR and will not be recreated unless you click a checkbox below.

Detected dependencies

docker-compose
docker-compose.yaml
github-actions
.github/workflows/lint.yml
  • actions/checkout v3@ac593985615ec2ede58e132d2e21d2b1cbd6127c
  • actions/checkout v3@ac593985615ec2ede58e132d2e21d2b1cbd6127c
  • actions/checkout v3@ac593985615ec2ede58e132d2e21d2b1cbd6127c
  • actions/setup-python v4@d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435
  • actions/checkout v3@ac593985615ec2ede58e132d2e21d2b1cbd6127c
  • actions/setup-python v4@d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435
  • actions/checkout v3@ac593985615ec2ede58e132d2e21d2b1cbd6127c
  • actions/setup-python v4@d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435
  • actions/checkout v3@ac593985615ec2ede58e132d2e21d2b1cbd6127c
  • actions/setup-python v4@d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435
  • actions/checkout v3@ac593985615ec2ede58e132d2e21d2b1cbd6127c
  • actions/setup-python v4@d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435
.github/workflows/stale.yml
  • actions/stale v5@99b6c709598e2b0d0841cd037aaf1ba07a4410bd
.github/workflows/test.yml
  • actions/checkout v3@ac593985615ec2ede58e132d2e21d2b1cbd6127c
  • actions/setup-python v4@d27e3f3d7c64b4bbf8e4abfb9b63b83e846e0435
  • actions/upload-artifact v3@0b7f8abb1508181956e8e162db84b466c27e18ce
  • actions/upload-artifact v3@0b7f8abb1508181956e8e162db84b466c27e18ce
  • codecov/codecov-action v3.1.0@81cd2dc8148241f03f5839d295e000b8f761e378
pip_requirements
requirements-test.txt
  • bandit ==1.7.4
  • black ==22.12.0
  • flake8 ==6.0.0
  • isort ==5.11.4
  • mypy ==0.991
  • pytest ==7.2.0
  • pytest-cov ==4.0.0
  • pytest-mock ==3.10.0
requirements.txt
  • cachetools ==5.2.0
  • certifi ==2022.12.7
  • charset-normalizer ==2.1.1
  • gbq ==1.0.1
  • google-api-core ==2.11.0
  • google-auth ==2.15.0
  • google-cloud-bigquery ==3.4.1
  • google-cloud-core ==2.3.2
  • google-crc32c ==1.5.0
  • google-resumable-media ==2.4.0
  • googleapis-common-protos ==1.57.0
  • grpcio ==1.51.1
  • grpcio-status ==1.51.1
  • idna ==3.4
  • packaging ==21.3
  • pip ==22.0.4
  • proto-plus ==1.22.1
  • protobuf ==4.21.12
  • pyasn1 ==0.4.8
  • pyasn1-modules ==0.2.8
  • pydantic ==1.10.2
  • pyparsing ==3.0.9
  • python-dateutil ==2.8.2
  • requests ==2.28.1
  • rsa ==4.9
  • setuptools ==58.1.0
  • six ==1.16.0
  • typing_extensions ==4.4.0
  • urllib3 ==1.26.13
  • wheel ==0.37.1

  • Check this box to trigger a request for Renovate to run again on this repository

Add support for SQL DDL

It would be useful for our project if we could have buildkite create BigQuery database objects using SQL DDL statements rather than json-formatted schema descriptions.

In priority order, it would be helpful for us to have:

  • Table creation. CREATE TABLE x ( ) or CREATE TABLE x AS SELECT FROM y We would like to have support for CLUSTER and PARTITION clauses.
  • View creation
  • Stored procedure creation

We currently use tables and views extensively, and we have used BQ stored procedures in the past. With regard to table creation, our current approach is to drop and rebuild the table upon each merge event. However, other teams might like to see the ability to alter table add column without dropping existing table (ie preserve existing data). Another point to note is that when changing the partition key, BQ does not allow CREATE or REPLACE in one step. In order to change partitioning, a 2-step process is needed, an explicit DROP TABLE, followed by the 2nd step CREATE TABLE.

Only run changed files

Description

  • Currently the plugin runs all the files in a directory that has changed
  • The plugin should only execute files that are changed/updated in the current commit

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.