Comments (4)
Also, I have tried to force the partitioner and I am not getting the same partition as the kafka java driver for example
from kt.
hi @vmaurin thanks for the feedback and thanks for the hint! i just pushed a commit to pass the partitioner
argument along, would you mind testing it? to get the latest version:
go get -u github.com/fgeller/kt
from kt.
Thx for the quick fix. Partitioner option is taken in account now
For the mismatch with java partitioner, it seems it is using a different hashing algorithm
https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/producer/internals/DefaultPartitioner.java
Not having the same behavior is not really a "bug", but it will end with unexpected result if both kt and a standard kafka producer are used to produce on the same topic (no proper log compaction, unordered read for the same key)
from kt.
closing this for now, will document more details on #74 for the partitioner issue
from kt.
Related Issues (20)
- update topic
- Add -version command line option to indicate which version of kt is running
- Installation failure on Centos7 VM HOT 4
- improve certificates for system test HOT 1
- Add env KT_VERSION for -version
- kt group usability
- CRC didn't match HOT 3
- Feature request: Support parsing value as json HOT 2
- Can't use tk, after update macSO to Monterey HOT 3
- Seeing escape char, if producer from kotlin HOT 4
- Error || client has run out of available brokers HOT 2
- fatal error: runtime: bsdthread_register error HOT 2
- Quiet mode to avoid printing informational messages to stderr HOT 6
- Version string of v13.1.0 is still v13.0.0 HOT 1
- install from release tag v13.1.0 fails HOT 1
- Tolerate already existing topic
- set security.protocol to SASL_SSL??? HOT 1
- KT built for Win10/11 is possibly leaking memory HOT 3
- Non-zero exit code in case of warnings
- New Auth Mechanism SASL_SSL SCRAM-SHA-256 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kt.