Comments (7)
我试了试 。CDC的earliest模式在这块是不支持下划线的
from flink-cdc.
properties.setProperty("database.history.kafka.bootstrap.servers", "kafka1:9092");
properties.setProperty("database.history.kafka.topic", "demo1");
properties.setProperty("key.converter", "org.apache.kafka.connect.json.JsonConverter");
properties.setProperty("value.converter", "org.apache.kafka.connect.json.JsonConverter");
上面这些属性可以不设置,但似乎没什么影响,我按照 你的代码,没有重现你的问题,我这边是正常的。你可以按照下面的方法定位下
- 首先确保下mysql是否设置了如下配置:
server-id = 123
log_bin = mysql-bin
binlog_format = ROW
binlog_row_image = FULL
expire_logs_days = 10
- 如果mysql设置正确,再确认user是否用足够的权限
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'user' IDENTIFIED BY 'password';
from flink-cdc.
properties.setProperty("database.history.kafka.bootstrap.servers", "kafka1:9092");
properties.setProperty("database.history.kafka.topic", "demo1");
properties.setProperty("key.converter", "org.apache.kafka.connect.json.JsonConverter");
properties.setProperty("value.converter", "org.apache.kafka.connect.json.JsonConverter");
上面这些属性可以不设置,但似乎没什么影响,我按照 你的代码,没有重现你的问题,我这边是正常的。你可以按照下面的方法定位下
- 首先确保下mysql是否设置了如下配置:
server-id = 123 log_bin = mysql-bin binlog_format = ROW binlog_row_image = FULL expire_logs_days = 10
- 如果mysql设置正确,再确认user是否用足够的权限
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'user' IDENTIFIED BY 'password';
from flink-cdc.
是Mysql DatabaseName大小写的问题,我猜想应该是debezium 会将 我传入的 ‘Test’ 转化为 ‘test’,然后去找对应的schema,所以会抛这样的异常
from flink-cdc.
是Mysql DatabaseName大小写的问题,我猜想应该是debezium 会将 我传入的 ‘Test’ 转化为 ‘test’,然后去找对应的schema,所以会抛这样的异常
正解,是debezium获取到mysql里的所有数据库的时候,会和你传入的 dbname比较,比较的时候传入的dbname被转成小写了,所以tableid找不到。
from flink-cdc.
from flink-cdc.
mysql CDC的earliest模式不支持表名带下划线的. 这个问题官方什么时候回修复
from flink-cdc.
Related Issues (20)
- flink cdc 2.4.2版本关于报错io.debezium.DebeziumException: Failed to deserialize data of EventHeaderV4 的问题 HOT 1
- Exception in thread "main" java.lang.NoSuchMethodError: 'void org.apache.flink.streaming.runtime.operators.sink.CommitterOperatorFactory.<init>(org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink, boolean, boolean)' HOT 3
- Information that has disappeared from github appears on the web page. HOT 1
- DataStreamSource oracle ID HOT 1
- Information that has disappeared from github appears on the web page. HOT 2
- supported mysql8.4? HOT 1
- Flink 1.18.1 and 1.19.0 having build jdk 1.8 and causing incompatibilities with Java 17 HOT 3
- update operation does not take effect HOT 5
- mysql pipeline connector lost table which database and table with the same name
- Caused by: java.lang.ClassCastException: cannot assign instance of org.apache.doris.flink.cfg.DorisOptions to field org.apache.flink.cdc.connectors.doris.sink.DorisMetadataApplier.dorisOptions of type org.apache.doris.flink.cfg.DorisOptions in instance of org.apache.flink.cdc.connectors.doris.sink.DorisMetadataApplier HOT 2
- flink-cdc sql sqlserver HOT 4
- [ERROR] Could not execute SQL statement. Reason: java.io.StreamCorruptedException: unexpected block data HOT 1
- lost data when gtid with Multiple transaction id on mgr cluster HOT 3
- flinkcdc3 official website operation error HOT 5
- When restoring a task from a savepoint, tables that were previously synchronized but later deleted still exist in a state HOT 1
- java.lang.IllegalStateException: Failed to send request to coordinator: com.ververica.cdc.runtime.operators.schema.event.ReleaseUpstreamRequest@5b433541 HOT 3
- addSplits only Snapshot,not foud binlog,so, incrementing data don't sync to sink,need help HOT 2
- 驱动程序无法通过使用安全套接字层(SSL)加密与 SQL Server 建立安全连接。错误:“Unexpected rethrowing”。 HOT 1
- flink1.18.1 + flink-cdc3.0.1 无法通过配置scanNewlyAddedTableEnabled=true实现无需重启作业能够识别符合tableList(正则表达式)的表采集数据 HOT 3
- 我想通过api来提交yaml文件的flinKcdc 任务,来取代flink-cdc.sh task.yaml 目前支持吗?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flink-cdc.