sutugin Goto Github PK

aerodrop

REST and Memcache proxy for aerospike

connectors

Connectors for Delta Lake

data-generator

User web sessions data generator written in Python, for Kafka, Kinesis or local file system sinks

data-model-generator

Data model generator based on Scala case classes

deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

delta

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

deordie-meetups

DE or DIE meetup made by data engineers for data engineers. Currently in Russian.

geotrellis

GeoTrellis is a geographic data processing engine for high performance applications.

metorikku

A simplified, lightweight ETL Framework based on Apache Spark

odsc-west-streaming-trends

All Data, Relevant Information, Scripts, and Applications for the Open Data Science Conference (2018)

ru-neophyte-guide-to-scala

Перевод на русский серии статей Daniel Westheide "The Neophyte's Guide to Scala"

sbt-common-settings

collections of common plugins and settings for sbt

scala-best-practices

A collection of Scala best practices

scala-exercises

The easy way to learn Scala.

scalacaster

Purely Functional Algorithms and Data Structures in Scala

shc

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

smartdata-fp-spark

sope

Apache Spark ETL Utilities

spark-clickhouse-plugin

The most intuitive Spark Plugin for interacting with Clickhouse

spark-docker

Official Dockerfile for Apache Spark

spark-google-analytics

A Spark package for retrieving data from Google Analytics

spark-hive-streaming-sink

A sink to save Spark Structured Streaming DataFrame into Hive table

spark-http-streaming

Running Apache Spark Structured Streaming job on the local machine with an HTTP web server as a streaming source.

spark-package-cmd-tool

A command line tool for Spark packages

spark-partition-sizing

Sizing partitions in Spark

spark-platform

Basic Spark utilities

spark-scala-examples

This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language

spark-scala-playground

Sample processing code using Spark 2.1+ and Scala

spark-schema-registry

Schema Registry integration for Apache Spark

spark-sql-kafka-offset-committer

Kafka offset committer for structured streaming query