Code Monkey home page Code Monkey logo

Comments (6)

licongchao avatar licongchao commented on September 15, 2024 1

@mshustov Cause Avro has only a few Primitive Types, but there's lots of data types in ClickHouse. If these types are ignored when using, exceptions will occur according to the current implementation.
It has several possible solutions, the first one is to mapping all types within ClickHouse data type. but i think it will cause lots of efforts. The second one is to point out which data types in ClickHouse is already implemented. The root cause of my exception is UINT64 which i'm using but it hasn't been covered, and it cannot pass the data schema validation.
Hope it works, the connector is helpful. thank you.

from clickhouse-kafka-connect.

licongchao avatar licongchao commented on September 15, 2024

I looked into the source code, and found the root cause is the type mismatch, Also in com.clickhouse.kafka.connect.sink.db.mapping.Column, it only includes only a few types in clickhouse.
If there's some avro type and clickhouse type mapping document, it will be helpful for the user.

from clickhouse-kafka-connect.

licongchao avatar licongchao commented on September 15, 2024

configuration issue, not a bug, maybe should deliver an enhancement

from clickhouse-kafka-connect.

mshustov avatar mshustov commented on September 15, 2024

configuration issue, not a bug, maybe should deliver an enhancement

@licongchao what would you suggest adding to the documentation to improve the user experience?

from clickhouse-kafka-connect.

mzitnik avatar mzitnik commented on September 15, 2024

The only types currently not supported by the Sink are bytes & struct as value. We introduce some implicit conversions within Dates see #63 issue [#57]. If you see any other need to implicit conversions, please open an issue, and we will address it.

from clickhouse-kafka-connect.

Paultagoras avatar Paultagoras commented on September 15, 2024

Given the code added to v0.0.10 by @hamsterready this should be resolved - if it continues to persist, please reopen and thanks!

from clickhouse-kafka-connect.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.