simplesteph / kafka-streams-course Goto Github PK

View Code? Open in Web Editor NEW

745.0 51.0 425.0 58 KB

Learn Kafka Streams with several examples!

Home Page: https://www.udemy.com/kafka-streams/?couponCode=GITHUB

Java 85.71% Scala 14.29%

kafka kafka-streams learning udemy

kafka-streams-course's Introduction

Learning

This is a companion repository for my Kafka Streams course on Udemy

Happy learning!

Content

Starter project with dependencies
Word Count to learn the basic API
Favourite Colour for a more advanced example (Scala version included)
Bank Balance to demonstrate exactly once semantics
User Event matcher to learn about joins between KStream and GlobalKTable.

kafka-streams-course's People

Contributors

Stargazers

Watchers

Forkers

kaiwaehner cristinanegrean gamussa kvasagiri tmrvivian tejashtarun14 patrika1979 venkareddy37 manojbehl aarontay radhikari54 g33kmaddy bijoythomask prakashmcam fumengyao5544 nazender buhijs brianfelder ngoro7 dbolshak umit mshaulskiy arunprasadbh pobrienjhu martowu peaceglory cmdphantom abdul99 taurus2819 chrisccoy moacybarros david-romero jerrywangal bdso ktpm489 amir20 feiniaoyuyu sffej jeperez mukesh210 cipri7329 chrisdoberman skashan-ali cheewaphat qiuzhanghua bjaggi nilportugues vibhatha asantos2000 riveryong dipjyotimetia masoud2v dwtcourses agungw132 devsaik t1seungy syd-m chengat1314 y-men chandranbgl ykmarupudi12 hytnku2016 adityaautomator otoukebri ywang412 khajaasmath786 janaidu01 vamsekumar djoker911 lospejos azurecloudmonk muarshad01 arunkumar6545 rayanegouda oopsaleem nursike swamx abhirj87 ehdez73 tristindavis andreizhoraven umapathyv hykavitha phillarby denis554 skilledminds jagadeeshtechmind adityakumar130901 adityakumar1309 joserfjuniorllms nickrbk dinukadev tayfourius srqway nataliiakushnirenko msellekahmed filareta a-poly thimotyb arvindkasale08

kafka-streams-course's Issues

Outer pom can be added

An outer pom can be added, with module information for the directories contained within.

Update readme with build status tag

Lets update the readme file to show the travis build status tag. It looks good and you dont have to open travis just to see how the build went with the last push.

Update - kafka-streams 3.X

As an Udemy user who recently bought and did the course; I would like to have this content updated.

If this is something that you ( @simplesteph ) would also have the time/will to do, I can volunteer to push a new branch with the latest kafka version so you can have a look. 😃

java.lang.UnsatisfiedLin kError: \AppData\Local\Temp\librocksdbjni5690556299205306066.dll: Can't find dependent libraries

Getting the below error, when I ran the words count sample,

INFO stream-thread [wordcount-application-0f0f6e16-c20b-4243-8ae3-9e85c90f8510-StreamThread-1] Stream thread shutdown co
mplete (org.apache.kafka.streams.processor.internals.StreamThread:1072)
WARN stream-thread [wordcount-application-0f0f6e16-c20b-4243-8ae3-9e85c90f8510-StreamThread-1] Unexpected state transiti
on from ASSIGNING_PARTITIONS to DEAD. (org.apache.kafka.streams.processor.internals.StreamThread:978)
Exception in thread "wordcount-application-0f0f6e16-c20b-4243-8ae3-9e85c90f8510-StreamThread-1" java.lang.UnsatisfiedLin
kError: C:\Users\snarasi\AppData\Local\Temp\librocksdbjni5690556299205306066.dll: Can't find dependent libraries
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(Unknown Source)
at java.lang.ClassLoader.loadLibrary(Unknown Source)
at java.lang.Runtime.load0(Unknown Source)
at java.lang.System.load(Unknown Source)
at org.rocksdb.NativeLibraryLoader.loadLibraryFromJar(NativeLibraryLoader.java:78)
at org.rocksdb.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:56)

A travis-ci job can be configured for atleast master branch

A travis-ci job can be configured for at least the master branch.
Or some other openly available build tool.

Question: Where can I find the source code

@simplesteph I am going through the Running your first Kafka Streams Application: WordCount part of the Apache Kafka Series - Kafka Streams for Data Processing on Safari and at 3:29 you are referencing course-intro-mac-linux script. Where can I find the source code for that ? I went through all the slides and resources, but couldn't find anything other than this repo simplesteph/kafka-streams-course

Shutdown Hook Unreachable

kafka-streams-course/word-count/src/main/java/com/github/simplesteph/udemy/kafka/streams/WordCountApp.java

Line 61 in 8cb61b0

Runtime.getRuntime().addShutdownHook(new Thread(streams::close));

Update to Kafka 1.0.0

Transform the code and the dependencies so that it's compatible with Kafka Streams 1.0.0 library.

Should be a fun learning exercise, feel free to submit a PR!

maven build is throwing error

[ERROR] Failed to execute goal on project bank-balance-exactly-once: Could not resolve dependencies for project com.gith
ub.simplesteph.udemy.kafka.streams:bank-balance-exactly-once:jar:1.0-SNAPSHOT: Failed to collect dependencies for [org.a
pache.kafka:kafka-streams:jar:0.11.0.1 (compile), org.apache.kafka:kafka-clients:jar:0.11.0.1 (compile), org.slf4j:slf4j
-api:jar:1.7.25 (compile), org.slf4j:slf4j-log4j12:jar:1.7.25 (compile), junit:junit:jar:4.12 (test)]: Failed to read ar
tifact descriptor for org.apache.kafka:kafka-streams:jar:0.11.0.1: Could not transfer artifact org.apache.kafka:kafka-st

999 refused: Connection refused: connect -> [Help 1]