Code Monkey home page Code Monkey logo

dbt-cloud-snowflake-demo-template's Introduction

Welcome to the dbt Labs Snowflake Demo Project!

This dbt project is intended to showcase key Snowflake + dbt functionalities in terms of workflow, modeling, and operationalizing.

Requirements

In order to successfully run this project, you will need the following:

Using the demo project

This project was built with the intent to be used with the dbt Cloud IDE and the UserFlow guided tour but if you're unable to do this, here are the steps.

  1. Read the entire README
  2. Check out the dbt_project.yml file. There you will find where we have defined our materializations, query tags, warehouse sizes, and hooks.
  3. Go to models/staging/tpch/stg_tpch_customers.sql. Read about how we write our models
  4. Compile the code for stg_tpch_customers
  5. Run dbt deps to install all the packages in the packages.yml
  6. Run dbt run to run all of your dbt models.
  7. Look at the logs (under details) to see what SQL was ran.
  8. Run the show_incremental_model query in the analysis folder by clicking on Preview Data
  9. Run dbt run -m incremental_dim_orders to run the model incrementally
  10. Run the show_incremental_model query in the analysis folder again with Preview Data.
  11. Take a look at the incremental logic in incremental_dim_orders
  12. Run dbt test to run the tests on your dbt models. Check out the models/staging/tcph/stg_tpch.yml file to see how tests are applied.
  13. Generate docs by running dbt docs generate and click on the View Docs on the left hand side.
  14. Check out the docs site and click on the blue button on the botton to view the DAG. Right click on a node to refocus. Then right click again to view the docs.
  15. Create a production environment by clicking on the hamburger menu > environments.
  16. Create a production job by clicking on the hamburger menu > jobs > create the job.
  17. Run the production job.

If you have time, take a look at other aspects of the project. We have included other fun features for you to see, including:

  • How to change output based on environments
  • How to dynamically pivot vs hardcoding your pivot

Resources:

  • Learn more about dbt in the docs
  • Check out Discourse for commonly asked questions and answers
  • Join the chat on Slack for live discussions and support
  • Find dbt events near you
  • Check out the blog for the latest news on dbt's development and best practices

Help out:

This is a open source project. If you want to contribute to this project/find any issues, interact with us on the repository

dbt-cloud-snowflake-demo-template's People

Contributors

amychen1776 avatar iktl avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

dbt-cloud-snowflake-demo-template's Issues

dbt_utils doesn't support version 1.0.1

When running step 5 of the readme: dbt-deps

04:33:08 Installing dbt-labs/dbt_utils
Runtime Error
Failed to read package: Runtime Error
This version of dbt is not supported with the 'dbt_utils' package.
Installed version of dbt: =1.0.1
Required version of dbt for 'dbt_utils': ['>=0.20.0', '<0.22.0']
Check the requirements for the 'dbt_utils' package, or run dbt again with --no-version-check

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.