Comments (13)
This is due to the snappy-java framing that will sometimes create multiple frames, which rdkafka currently doesn't support.
from librdkafka.
The problem I saw was on the publisher side though, where messages simply
have local timeout when using snappy
On Wednesday, January 8, 2014, Magnus Edenhill wrote:
This is due to the snappy-java framing that will sometimes create multiple
frames, which rdkafka currently doesn't support.—
Reply to this email directly or view it on GitHubhttps://github.com//issues/55#issuecomment-31882548
.
from librdkafka.
Can you reproduce with rdkafka_performance or .._example?
Or run with "debug" set to "broker,topic,msg"?
from librdkafka.
Reproduced with example.
On Wednesday, January 8, 2014, Magnus Edenhill wrote:
Can you reproduce with rdkafka_performance or .._example?
Or run with "debug" set to "broker,topic,msg"?—
Reply to this email directly or view it on GitHubhttps://github.com//issues/55#issuecomment-31884205
.
from librdkafka.
Perfect, can you provide command lines?
from librdkafka.
./rdkafka_example -P -b kafkadevcluster1-1.masked.com:5757,
kafkadevcluster1-2.masked.com:5757,kafkadevcluster1-3.masked.com:5757 -p 8
-t LaraReplicator_kafkacluster4 -z snappy
Error on publisher with debug on:
1389224014.657 RDKAFKA-7-MSGSET: rdkafka#producer-0:
d145931-004.masked.com:5757/2: MessageSet with 1 message(s) delivered^M
1389224014.657 RDKAFKA-7-MSGSET: rdkafka#producer-0:
d145931-004.masked.com:5757/2: MessageSet with 1 message(s) encountered
error: Err-65535?^M
On Wednesday, January 8, 2014, Magnus Edenhill wrote:
Perfect, can you provide command lines?
—
Reply to this email directly or view it on GitHubhttps://github.com//issues/55#issuecomment-31887813
.
from librdkafka.
Is there any exception on the broker when this happens?
Can you run with debug enabled?: ... -d all and see if it says anything more specific about that unknown error.
from librdkafka.
I can reproduce it against an 0.8.0 (beta) cluster and not 0.8.1 so maybe
it was a cluster/broker thing that was fixed?
On Wednesday, January 8, 2014, Magnus Edenhill wrote:
Is there any exception on the broker when this happens?
Can you run with debug enabled?: ... -d all and see if it says anything
more specific about that unknown error.—
Reply to this email directly or view it on GitHubhttps://github.com//issues/55#issuecomment-31888482
.
from librdkafka.
Maybe, but Ive been running most of my tests on 0.8.0 beta.
Would be very interesting with the debug output.
from librdkafka.
Unfortunately I don't have access to the cluster hosts/logs. I guess try
and reproduce it on your side and if you can't don't worry about it.
On Thursday, January 9, 2014, Magnus Edenhill wrote:
Maybe, but Ive been running most of my tests on 0.8.0 beta.
Would be very interesting with the debug output.—
Reply to this email directly or view it on GitHubhttps://github.com//issues/55#issuecomment-31908762
.
from librdkafka.
I cant reproduce it and would need more to go on.
Let me know if you find more information.
2014/1/9 winbatch [email protected]
Unfortunately I don't have access to the cluster hosts/logs. I guess try
and reproduce it on your side and if you can't don't worry about it.On Thursday, January 9, 2014, Magnus Edenhill wrote:
Maybe, but Ive been running most of my tests on 0.8.0 beta.
Would be very interesting with the debug output.—
Reply to this email directly or view it on GitHub<
https://github.com/edenhill/librdkafka/issues/55#issuecomment-31908762>
.—
Reply to this email directly or view it on GitHubhttps://github.com//issues/55#issuecomment-31922582
.
from librdkafka.
Got the broker log. Looks like snappy wasn't in the classpath/noclassdeffounderror
from librdkafka.
Okay, good news.
Thank you.
from librdkafka.
Related Issues (20)
- producer continually refreshing client metadata after broker disconnection HOT 8
- APIVERSION_QUERY timeout in first connection with TLSv1.3 kafka broker
- mklove/modules/configure.base: line 2126: source: configure.self: file not found on windows HOT 3
- Consumer initialization hangs
- rd_kafka_metadata can cause a UNKNOWN_TOPIC_OR_PART message HOT 10
- Expose `rd_kafka_global_init` to prevent forking issues on macOS HOT 7
- librdkafka cannot be built with LLD linker HOT 2
- Upgrade CMake minimum version
- Issue with Confluent Kafka Python and MSK: "metadata information unknown" HOT 1
- Message is 'stuck' when the network cable is unplugged
- adminClient describeConsumerGroups leads to python: rdkafka_queue.h:1052: rd_kafka_enq_once_del_source_return: Assertion `eonce->refcnt > 0' failed. HOT 2
- Producer never reconnects to broker HOT 3
- ListOffsets loop of failed requests on leader epoch change until timeout happens HOT 3
- Question: Can event_cb be called on a stopped producer/consumer? HOT 1
- Data race in `rd_kafka_broker_timeout_scan`
- rd_kafka_produceva: double free headers on message sending error HOT 2
- coop sticky algo on large partition number HOT 1
- Duplicate messages could be received when resuming partitions that weren't paused
- Some components use `strcmp` which is vulnerable to timing attacks
- Timeout overflows when over 2047.48
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from librdkafka.