mubaraka Goto Github PK

auto-hive-join

Metadata driven hive table generation and joins implemented in python

aws-kinesis-producer

bashmysql

Runs a MySQL query to parse metadata and column data.

chronic-kidney-disease-predictor

A manually programmed Logistic Regression implementation of a Chronic Kidney Disease predictor.

cifar10-image-classification

It consists of 60,000 32x32 color images containing one of 10 object classes, with 6000 images per class.

comet-data-pipeline

Comet Data Pipeline is a Spark Ingestion Framework fo Batch (Hadoop) & Streaming (Coming) Systems

computationalhealthcare

A platform for analysis & development of machine learning models using large de-identified healthcare datasets.

corgi

Corgi 柯基：MySQL & Oracle 到 Hive 批量数据集成服务

data-profiling

a set of scripts to pull meta data and data profiling metrics from relational database systems

dataload

Spark数据加载 To (HDFS/Hive)

datareplicator

This scala pet-project attempts to create a data replication application that will help replicate base and incremental data from source to target data stores

datascience-portfolio

This is a repository of my data science projects showcasing my abilities with cloud computing deployment, machine learning, and advanced interactive data visualization techniques to produce value in real-world problems.

dbtable2class

Generate Scala case class based on database table metadata

deep-learning-pyspark

Deep Learning with Apache Spark and Deep Cognition

fileingestor

A simple program to put files from a directory into HDFS with the added functionality and defining how that action will happen

hadoopinternals

Diagrams describing Apache Hadoop internals (2.3.0 or later).

healthcareai-py

Python tools for healthcare machine learning

heartfailureprediction

Predicting Heart Failure using Ensemble Learning with Spark

hive_meta_transfer

Transfer the hive metadata from one cluster to another

hive_metadata_utils

Find Hive Tables by Table or Column Names

hivemeta-syncer

Sync hive database/table information from its metastore to a mysql database

lzspark

machine-learning-projects

These projects all focus on the various algorithms under the umbrella of machine learning. Each project focuses on a specific algorithm and involves a hypothetical scenario where I need to implement the algorithm to arrive at a solution to a "real world" problem. Since the focus is on the actual algorithm and analysis of its performance the datasets are fairly clean and simple. In reality a huge chunk of the time spent working with datasets will be getting it into a form so these algorithms can perform appropriately.

mubys_spark

pyspark-churn-prediction

Churn Prediction with PySpark using MLlib and ML Packages

real-world-machine-learning-projects-with-scikit-learn

Real-World Machine Learning Projects with Scikit-Learn [Video], Published by Packt

sftp_ingestion

Project to load data from SFTP source into HDFS and Spark

spark-and-mllib-projects

This repository contains Spark, MLlib, PySpark and Dataframes projects

spark-data-ingest

Spark application for ingest data into data lake

spark-etl