Code Monkey home page Code Monkey logo

snowflake_kaggle_titanic_challenge's Introduction

Snowflake: Titanic - Machine Learning from Disaster

Source:
https://www.kaggle.com/competitions/titanic

The Challenge

The sinking of the Titanic is one of the most infamous shipwrecks in history.

On April 15, 1912, during her maiden voyage, the widely considered “unsinkable” RMS Titanic sank after colliding with an iceberg. Unfortunately, there weren’t enough lifeboats for everyone onboard, resulting in the death of 1502 out of 2224 passengers and crew.

While there was some element of luck involved in surviving, it seems some groups of people were more likely to survive than others.

In this challenge, we ask you to build a predictive model that answers the question: “what sorts of people were more likely to survive?” using passenger data (i.e. name, age, gender, socio-economic class, etc).

What Data Will I Use in This Competition?

In this competition, you have access to a Snowflake table called PASSENGERS.
This table contains the PASSENGER_ID and a label-column SURVIVED which indicates whether a passenger sruvived or not.
We know the survival status for 891 passengers but the status for the remaining 418 passengers is unknown and therefore missing in that table.

In addition, your team of smart datascientists already registered a couple of features in your Snowflake Feature Store.
This feature store includes information about the name, age, gender, socio-economic class, etc.

Use your datascience expertise to:

  • Explore the existing Data
  • Develop and Register new Features in the Feature Store
  • Train and Register a Machine Learning Model in the Model Registry
  • Create Scores for passengers with unknown survival status

Evaluation

Goal

It is your job to predict if a passenger survived the sinking of the Titanic or not.
For each passenger where the survival status is unknown, you must predict a 0 (died) or 1 (survived).

Metric

Your score is the percentage of passengers you correctly predict. This is known as accuracy.

Get Started

Register for a free Snowflake Trial Account:

Important

Some features like the Feature Store require Snowflake Enterprise Edition or higher. Availability of specific Cortex LLM models can be found here.

Integrate this Github Repository with Snowflake by running the following SQL code in a Snowflake Worksheet:

USE ROLE ACCOUNTADMIN;

-- Create warehouses
CREATE WAREHOUSE IF NOT EXISTS TRAIN_WH WITH WAREHOUSE_SIZE='MEDIUM';
CREATE WAREHOUSE IF NOT EXISTS COMPUTE_WH WITH WAREHOUSE_SIZE='X-SMALL';

-- Create a fresh Database
CREATE OR REPLACE DATABASE KAGGLE_TITANIC_CHALLENGE;
USE SCHEMA KAGGLE_TITANIC_CHALLENGE.PUBLIC;

-- Create the integration with Github
CREATE OR REPLACE API INTEGRATION GITHUB_INTEGRATION_MICHAEL
    api_provider = git_https_api
    api_allowed_prefixes = ('https://github.com/michaelgorkow/')
    enabled = true
    comment='Michaels repository containing all the awesome code.';

-- Create the integration with the Github repository
CREATE GIT REPOSITORY TITANIC_CHALLENGE_REPO 
	ORIGIN = 'https://github.com/michaelgorkow/snowflake_kaggle_titanic_challenge' 
	API_INTEGRATION = 'GITHUB_INTEGRATION_MICHAEL' 
	COMMENT = 'Michaels repository containing all the awesome code.';

-- Fetch most recent files from Github repository
ALTER GIT REPOSITORY TITANIC_CHALLENGE_REPO FETCH;

-- Run the Setup Script from Github
-- You should see three tables (PASSENGER, PASSENGER_FEATURES, PASSENGER_KAGGLE_FEATURES$V1)
EXECUTE IMMEDIATE FROM @KAGGLE_TITANIC_CHALLENGE.PUBLIC.TITANIC_CHALLENGE_REPO/branches/main/_internal/setup.sql;

Explore the Example Notebook by creating a new Notebook from the integrated Github Repository using the challenge_demo.iypnb:

create_notebook_from_repository png

Make sure to add the required libraries to your Notebook by using the Package Picker at the top:

notebook_package_picker png

Excercise

After running the example it's your turn to try and improve the pipeline.
Create a new notebook, select the challenge_excercise.iypnb and add the required packages. This excercise notebook comes with predefined excercises but feel free to add any code you think is useful to improve the model.

Solution

You can check and run the solution by creating a notebook using the challenge_excercise_solution.iypnb.

Snowflake Features in this Challenge

API Documentation

snowflake_kaggle_titanic_challenge's People

Contributors

ccarrero-sf avatar michaelgorkow avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.