Code Monkey home page Code Monkey logo

customer-360-dbt's Introduction

VISITORS FOLLOWERS

Hello World! 👋


I'm Leah and welcome to my GitHub profile! :octocat:

Typing SVG

GitHub followers Gmail Badge LinkedIn Badge Medium Badge


GIF

Fun facts:

👩‍🎓 Former Marketing guru turned Data Science wizard with a Business degree in hand.

✍️ Master of Data Science and Innovation (MDSI) graduate from the University of Technology Sydney, armed with supercharged data skills.

🤔 If you don't write your SQL queries in uppercase, I don't trust you.

📈 Madly passionate about Modern Data Stacks, Data Engineering, DataOps, and saving the day with top-notch data governance practices for enterprise data architectures. Let's optimize that data flow!


Languages and Tools

Hadoop Spark AWS AWS Docker MongoDB Kubernetes Bash Linux Jenkins Git R Kafka PostgreSQL Postgres Python Cassandra

👇 Check out my latest Medium blog

Recent Article 0

Recent Article 1

Recent Article 2

Recent Article 3

Recent Article 4


Metrics 📈

Metrics

customer-360-dbt's People

Contributors

ndleah avatar

Stargazers

avatar avatar

Watchers

avatar avatar

customer-360-dbt's Issues

[contacts] Failed test: duplicate values on `contact_id`

Description

Test unique on id column of source table contacts failed.

Details of the test:

    tables:
      - name: contacts
        columns:
          - name: id
            tests:
              - unique
              - not null

Details of the error message:

11:53:57  23 of 58 WARN 1 source_unique_salesforce_contacts_id ........................... [WARN 1 in 0.11s]

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

Add tests for macros

Description

self-explanotary

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

Product Category Recommender

Description

How to implement Next Best Product Category?

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

improve dbt_project.yml config

Description

Any improvements made to the dbt_project.yml

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

add new features to `marketing_customers` table

Description

We'd like to enhance the customers model by adding few more attributes:

  • first_purchase_date and last_purchase_date (time of first and last purchase respectively)
  • total amount of purchase per category eg. columns like app_and_games_amount, beauty_amount etc. (refer to _web__sources.yml for a static list of product categories)

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

Allow switching between Postgres and Databricks syntax

Description

Macros contain Postgres-specific functions, however our production environment is in Databricks. How would you refactor them, to allow switching between these two syntax?

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

[transactions] Failed test: acceptance values for category columns

Description

When run dbt test on the source table transactions, it appears that the test on acceptance values has failed since there is a new category value detected.

Details of the test:

tests:
    - accepted_values:
        config:
          severity: warn
        values: 
          ['Apps & Games', 'Beauty', 'Books', 'Clothing, Shoes & Accessories', 'Movies & TV', 'Sports, Fitness & Outdoors']

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

performance tuning

Description

Add any tips and tricks to improve query performances to the dbt project

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

Add data warehouse layers to the dbt project

Description

This is an additional improvements to improve the data warehousing side of this dbt project. The ideas are to implement:

  • Implement Kimball Modelling
  • Add any extra transformation layer to make it even clearer

Type of issue

  • Assignments
  • Additional Improvements
  • Documentation

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.