Comments (7)
This would be very useful indeed.
from storm-contrib.
Is it not? The current dependencies for the project seem to state that it's working with newer storm versions:
:provided {:dependencies [[storm "0.9.0-wip15"]
from storm-contrib.
I think 0.7 and 0.8 kafka will be in use for a long time, so it makes sense
to maintain two branches of storm-kafka for each respectively. It would be
awesome if someone did a PR for this, I personally haven't needed 0.8 yet.
Is it not? The current dependencies for the project seem to state that
it's working with newer storm versions:
Andrew is referring to kafka version. Yes the latest storm-kafka works with
0.9 storm.
On Tue, Sep 24, 2013 at 5:56 AM, Jarret Raim [email protected]:
Is it not? The current dependencies for the project seem to state that
it's working with newer storm versions::provided {:dependencies [[storm "0.9.0-wip15"]
—
Reply to this email directly or view it on GitHubhttps://github.com//issues/38#issuecomment-25000074
.
from storm-contrib.
See also here https://groups.google.com/forum/#!topic/storm-user/OXQ0a9ppcYM
from storm-contrib.
Use this project for Kafka 0.8: https://github.com/wurstmeister/storm-kafka-0.8-plus/
from storm-contrib.
Hi,
I am trying to integrate storm and kafka but I am facing issue such as I am able to deploy the topology but it is not listening to kafka messages.
Following are the maven dependencies I have used:
org.apache.storm
storm-core
0.9.1-incubating
org.apache.storm
storm-kafka
0.9.2-incubating
org.apache.kafka
kafka_2.10
0.8.0
org.apache.zookeeper
zookeeper
log4j
log4j
org.apache.kafka
kafka-clients
0.8.2.1
When I run this program it gives following log:
4670 [main] INFO backtype.storm.StormSubmitter - Jar not uploaded to master yet. Submitting jar...
4676 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar /home/sujeet/Downloads/fieldvantage/TimeSeriesDataMigration/target/TimeSeriesDataMigration-0.0.1-SNAPSHOT.jar to assigned location: /usr/local/storm/data/nimbus/inbox/stormjar-009d6969-b1fc-475a-8e3a-3d0b988fecdd.jar
4691 [main] INFO backtype.storm.StormSubmitter - Successfully uploaded topology jar to assigned location: /usr/local/storm/data/nimbus/inbox/stormjar-009d6969-b1fc-475a-8e3a-3d0b988fecdd.jar
4691 [main] INFO backtype.storm.StormSubmitter - Submitting topology TestTopology in distributed mode with conf {"topology.workers":1,"topology.message.timeout.secs":600,"topology.debug":false,"kafka.broker.properties":{"bootstrap.servers":"localhost:9092","acks":"1","value.serializer":"org.apache.kafka.common.serialization.StringSerializer","key.serializer":"org.apache.kafka.common.serialization.StringSerializer"}}
But when I am sending messages from Kafka producer it is unable to listen it.
Any help would be appreciable.
Thanks & Regards,
Sujeet Yadav
from storm-contrib.
Hi,
I too have the same issuewith kafka storm integration. I am not able to read from kafka topic when running on a single node cluster. Everything works fine while running in local mode.
@sujeetyadav Are you able to solve the issue.. ??
Any help will be highly appreciated.
Thanks in advance
Dennis
from storm-contrib.
Related Issues (20)
- storm kafka compilation issue HOT 1
- Serialization Issue in storm-state module for org.apache.hadoop.hdfs.DistributedFileSystem
- KafkaSpout should timeout all connection issues
- storm-rdbms RDBMSDumperBolt doesn´t works in cluster mode
- Unresolved dependencies
- TransactionalTridentKafkaSpout works correctly in local cluster, but fails to get any message in remote cluster HOT 4
- Non-commiters are unable to checkout submodules. HOT 1
- Pom.xml's module list references nothing that exists
- Pull requests for submodules HOT 2
- how can I set 'consumergroup' in storm-kafka?
- Kafka spout PartitionManager should emit failed tuples without replaying all data that follows
- storm-kafka: EOFException
- How to use Kafka-spout with clojure
- Any plans to support Kafka 0.8?
- Not able to update the submodules HOT 2
- [storm-rdbms] java.lang.NullPointerException when using storm on cluster mode HOT 3
- KafkaSpout - no args constructor
- storm cluster Wrong question
- License? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from storm-contrib.