buildlackey Goto Github PK

akka-fiddling

fiddle with akka and spray

akka-http-microservice

Example of (micro)service written in Scala & akka-http

cep

complex event processing code

docker-spark-standalone

:ship: Standalone Apache Spark Docker image

fabric8-k8s-fiddling

create a load balanced service (with externally accessible IP) in kubernetes using the fabric8 API.

featuregen

generate features for machine learning

gradle-test-configuration-plugin

Gradle plug-in that sets up testNG as test runner, and adds a new 'integrationTest' task

high-performance-spark-examples

Examples for High Performance Spark

jenkins-build-box-with-vagrant

Vagrant recipe for provisioning linux box with jenkins,java,maven and optionally, fortify

json-schema-validation-demo

short demo -- in scala -- of how to validate arbitrary JSON instance documents against a JSON schema

kafka-spark-testing

Code examples for article here: http://datalackey.com/2020/09/22/unit-integration-testing-kafka-and-spark/

kafka-spark-testing2

kafkaoffsetbug

reproducible steps for bug report on kafka 0.8.2.1 getOffsetsBefore API call.

ndbench

Netflix Data Store Benchmark

project.euler

solutions-to-various-discrete-math-number-theory-problems-while-i-learn-up-on-python

python_tictaktoe

learn/improve my python by programming this silly game

scala-multimodule-sample-project

A sample Scala project with multiple modules and Scalatra

scripts

spark-examples

spark sql, dataset/dataframe and structured streaming examples used to study for databricks certification exam

spark-scala-playground

Sample processing code using Spark 2.1+ and Scala

spark-streaming-group-by-event-time

code samples for this article: http://datalackey.com/2019/06/21/exploring-event-time-and-processing-time-in-spark-structured-streaming/

spark-struct-streaming-metrics-missing-on-aws

Demo of how when we deploy on AWS/EMR the structured streaming metrics tab shows no batches processed and no graphs

spark-structured-streaming-vs-dstreams

toy project illustrating how to process a mock stream of sensor data via Spark structured streaming and the (older) dstreams API

spark-testing-base

Base classes to use when writing tests with Spark

spark-testing-base-with-streaming

some examples of unit testing with spark streaming and spark sql using spark-testing-base (holden karau)

spark.examples.with.gradle6

A home for various Scala examples that I want to retain for posterity.

sparkstreamingfinddupwordsinfiles