Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] 多表同步运行一段时间cdc刷写日志正常打印 doris中相关无数据 #453

Open
3 tasks done
lanranjun opened this issue Aug 1, 2024 · 1 comment
Open
3 tasks done

Comments

@lanranjun
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

Version

1.6.1

What's Wrong?

前一天下午以 shell命令的形式启动 启动参数:
mysql-sync-database --database xxx--mysql-conf hostname=xxx --mysql-conf port=3306 --mysql-conf username=xxx--mysql-conf password=xxx --mysql-conf database-name=xxx--mysql-conf scan.startup.mode=latest-offset --mysql-conf server-id=5400-5410 --sink-conf fenodes=doris001:8030 --sink-conf username=xxx--sink-conf password=xxx--sink-conf jdbc-url=jdbc:mysql://xxx:9030 --sink-conf sink.label-prefix=label --table-conf replication_num=3 --table-conf enable_unique_key_merge_on_write=true --including-tables "table01|table02|table03" --table-suffix _full
今天早上查看数据,业务库mysql已经更新到8点多的数据 但是doris中数据最近的是在凌晨3点,查看taskmanager日志 正常打印刷写数据到doris信息,但是doris库查不到该时间段相关数据。又过一会查看taskmanager数据,业务库有了新数据,taskmanager也不打印刷写数据记录信息了,整个过程checkpoint都是正常执行,日志里也没有报错。。。
之前还遇到过不同步数据的情况:taskmanager打印列的信息 信息中的数据都是 内存地址信息 数据也不同步,重启才可以。

What You Expected?

是不是参数不对?或者写多了?

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@JNSimba
Copy link
Member

JNSimba commented Aug 22, 2024

Is checkpoint not enabled?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants