Streaming reference architecture built around Kafka.
A collection of components to build a real time ingestion pipeline.
Connector | Type | Description | Docs |
---|---|---|---|
BlockChain | Source | Kafka connect Blockchain source to subscribe to Blockchain streams and write to Kafka. | Docs |
Bloomberg | Source | Kafka connect Blockchain source to subscribe to Blockchain streams and write to Kafka. | Docs |
Cassandra | Source | Kafka connect Cassandra source to read Cassandra and write to Kafka. | Docs |
*DSE Cassandra | Sink | Certified DSE Kafka connect Cassandra sink task to write Kafka topic payloads to Cassandra. | Docs |
Druid | Sink | Kafka connect Druid sink to write Kafka topic payloads to Druid. | Docs |
Elastic | Sink | Kafka connect Elastic Search sink to write Kafka topic payloads to Elastic Search. | Docs |
HBase | Sink | Kafka connect HBase sink to write Kafka topic payloads to HBase. | Docs |
Hazelcast | Sink | Kafka connect Hazelcast sink to write Kafka topic payloads to Hazelcast. | Docs |
Kudu | Sink | Kafka connect Kudu sink to write Kafka topic payloads to Kudu. | Docs |
InfluxDb | Sink | Kafka connect InfluxDb sink to write Kafka topic payloads to InfluxDb. | Docs |
JMS | Sink | Kafka connect JMS sink to write Kafka topic payloads to JMS. | Docs |
Redis | Sink | Kafka connect Redis sink to write Kafka topic payloads to Redis. | Docs |
ReThinkDB | Source | Kafka connect RethinkDb source subscribe to ReThinkDB changefeeds and write to Kafka. | Docs |
ReThinkDB | Sink | Kafka connect RethinkDb sink to write Kafka topic payloads to RethinkDb. | Docs |
Yahoo Finance | Source | Kafka connect Yahoo Finance source to write to Kafka. | Docs |
VoltDB | Sink | Kafka connect Voltdb sink to write Kafka topic payloads to Voltdb. | Docs |
Akka Http and Reactive Kafka with Websocket and Server Send Event support. Supports limited SQL statements to stream and select from Kafka topics in real time.
Requires gradle 3.0 to build.
To build
gradle compile
To test
gradle test
To create a fat jar
gradle shadowJar
You can also use the gradle wrapper
./gradlew shadowJar