Comments (3)
emasab
commented on July 17, 2024
Hi @StephanDollberg , thanks for the report, can you reproduce it with AK too?
Does it happen after that fix in 2.3.0? The log has version 2.2.0
from librdkafka.
StephanDollberg
commented on July 17, 2024
Hi @StephanDollberg , thanks for the report, can you reproduce it with AK too?
I haven't tried that yet.
Does it happen after that fix in 2.3.0? The log has version 2.2.0
Sorry for not being clear, the issue still persist on latest master. It got introduced in the commit pointed out above -6dc7c71 (which in git speak is 2.2+something but the first released version is 2.3.0)
from librdkafka.
emasab
commented on July 17, 2024
I think it can happen in some particular cases because of this condition
librdkafka/src/rdkafka_msgset_writer.c
Line 877 in 2587cac
and the backoff that is not uniform across all messages of the same idempotent batch here:
librdkafka/src/rdkafka_partition.c
Line 925 in 6dc7c71
I'm going to check about reproducing and fixing this case
from librdkafka.
Related Issues (20)
- Resuming partitions not paused, manually or through incremental subscribe, can cause to restart consuming from a previous offset HOT 1
- Undesired partition migration happening because of stale metadata
- I am facing issue i try to build librdkafka and using CMake and it give me error for some library like unistd.h in transaction.h file HOT 1
- Transactional producer silently fails to commit a transaction. HOT 2
- libzstd not available at build time HOT 1
- Fails to set security.protocol to SSL HOT 2
- Typo in configuration property name
- Suppress EOF errors - only from logs HOT 1
- Using `rd_kafka_topic_conf_set` with `acks` set to `1` on a transactional producer crashes it
- Unable to receive any stats in the stats callback method HOT 1
- Unable to create broker thread error HOT 1
- when kafkaConsumer destory HOT 1
- consume data backlog after Heartbeat failed: REBALANCE_IN_PROGRESS: group is rebalancing
- Mock cluster's main thread does not retry when `poll()` returns EINTR, resulting in shutdown
- Compiling with Visual Studio 2022 HOT 1
- Cyrus/libsasl2 is missing a GSSAPI module HOT 8
- fetch from follower causes frequent rebalances on rolling restarts HOT 1
- Add QNX support
- Add support for offsetsForTimes in mock handlers
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from librdkafka.