Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

kafka sarama client data race #5090

Closed
Tracked by #2246
Rustin170506 opened this issue Apr 1, 2022 · 4 comments · Fixed by #5086
Closed
Tracked by #2246

kafka sarama client data race #5090

Rustin170506 opened this issue Apr 1, 2022 · 4 comments · Fixed by #5086
Labels
area/ticdc Issues or PRs related to TiCDC. component/test Unit tests and integration tests component. severity/minor type/bug The issue is confirmed as a bug.

Comments

@Rustin170506
Copy link
Member

Which jobs are flaking?

cdc_ghpr_kafka_integration_test

Which test(s) are flaking?

cli

Jenkins logs or GitHub Actions link

[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-361)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-362)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-363)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-364)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-365)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-366)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-367)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-368)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-369)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-370)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-371)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-372)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-373)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-374)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-375)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-376)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-377)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-378)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-379)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-380)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-381)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-382)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-383)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-384)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-385)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-386)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-387)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-388)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-389)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-390)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-391)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-392)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-393)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-394)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-395)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-396)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-397)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-398)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-399)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-400)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-401)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-402)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-403)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-404)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-405)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-406)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-407)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-408)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-409)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-410)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-411)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-412)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-413)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-414)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-415)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-416)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-417)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-418)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-419)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-420)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-421)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-422)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-423)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-424)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-425)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-426)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-427)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-428)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-429)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-430)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-431)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-432)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-433)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-434)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-435)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-436)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-437)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-438)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-439)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-440)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-441)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-442)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-443)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-444)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-445)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-446)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-447)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-448)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-449)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-450)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-451)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-452)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-453)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-454)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-455)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-456)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-457)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-458)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-459)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-460)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-461)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-462)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-463)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-464)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-465)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-466)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-467)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-468)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-469)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-470)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-471)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-472)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-473)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-474)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-475)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-476)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-477)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-478)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-479)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-480)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-481)[](https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline#step-997-log-482)[2022-04-01T02:48:48.961Z] + cdc.test -test.coverprofile=/tmp/tidb_cdc_test/cov.cli.cli.9154.out cli changefeed create --start-ts=432218131581632513 --sort-engine=memory '--sink-uri=kafka://127.0.0.1:9092/ticdc-cli-test-16814?protocol=open-protocol&partition-num=4&kafka-version=2.4.1&max-message-bytes=10485760' --tz=Asia/Shanghai -c=custom-changefeed-name

[2022-04-01T02:48:49.891Z] ==================

[2022-04-01T02:48:49.891Z] WARNING: DATA RACE

[2022-04-01T02:48:49.891Z] Read at 0x00000a6908d0 by goroutine 185:

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.version()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/version.go:8 +0x30

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*Broker).Open.func1.1()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/broker.go:183 +0x76

[2022-04-01T02:48:49.891Z]   runtime.deferreturn()

[2022-04-01T02:48:49.891Z]       /usr/local/go/src/runtime/panic.go:436 +0x32

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.withRecover()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/utils.go:43 +0x48

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*Broker).Open.func2()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/broker.go:172 +0x39

[2022-04-01T02:48:49.891Z] 

[2022-04-01T02:48:49.891Z] Previous write at 0x00000a6908d0 by goroutine 181:

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.version()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/version.go:11 +0x7e

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*Broker).Open.func1.1()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/broker.go:183 +0x76

[2022-04-01T02:48:49.891Z]   runtime.deferreturn()

[2022-04-01T02:48:49.891Z]       /usr/local/go/src/runtime/panic.go:436 +0x32

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.withRecover()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/utils.go:43 +0x48

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*Broker).Open.func2()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/broker.go:172 +0x39

[2022-04-01T02:48:49.891Z] 

[2022-04-01T02:48:49.891Z] Goroutine 185 (running) created at:

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*Broker).Open()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/broker.go:172 +0x3f0

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*client).Controller()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/client.go:529 +0x1b0

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.NewClusterAdminFromClient()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/admin.go:159 +0x3b

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.NewClusterAdmin()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/admin.go:152 +0x84

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/pkg/kafka.NewSaramaAdminClient()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/kafka/cluster_admin_client.go:40 +0x64

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cdc/sink.newKafkaSaramaSink()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cdc/sink/mq.go:366 +0x21b

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cdc/sink.init.2.func3()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cdc/sink/sink.go:116 +0x8c

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cdc/sink.New()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cdc/sink/sink.go:143 +0x2b1

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cdc/sink.Validate()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cdc/sink/sink.go:157 +0x144

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/pkg/cmd/cli.(*createChangefeedOptions).validateSink()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/cmd/cli/cli_changefeed_create.go:381 +0x98

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/pkg/cmd/cli.(*createChangefeedOptions).run()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/cmd/cli/cli_changefeed_create.go:436 +0x6b8

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/pkg/cmd/cli.newCmdCreateChangefeed.func1()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/cmd/cli/cli_changefeed_create.go:479 +0x151

[2022-04-01T02:48:49.891Z]   github.com/spf13/cobra.(*Command).execute()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/spf13/[email protected]/command.go:856 +0xad7

[2022-04-01T02:48:49.891Z]   github.com/spf13/cobra.(*Command).ExecuteC()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/spf13/[email protected]/command.go:974 +0x5c9

[2022-04-01T02:48:49.891Z]   github.com/spf13/cobra.(*Command).Execute()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/spf13/[email protected]/command.go:902 +0x2fd

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/pkg/cmd.Run()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/cmd/cmd.go:50 +0x300

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cmd/cdc.main()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cmd/cdc/main.go:27 +0x33

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cmd/cdc.TestRunMain()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cmd/cdc/main_test.go:35 +0xca

[2022-04-01T02:48:49.891Z]   testing.tRunner()

[2022-04-01T02:48:49.891Z]       /usr/local/go/src/testing/testing.go:1439 +0x213

[2022-04-01T02:48:49.891Z]   testing.(*T).Run.func1()

[2022-04-01T02:48:49.891Z]       /usr/local/go/src/testing/testing.go:1486 +0x47

[2022-04-01T02:48:49.891Z] 

[2022-04-01T02:48:49.891Z] Goroutine 181 (finished) created at:

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*Broker).Open()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/broker.go:172 +0x3f0

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*client).any()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/client.go:686 +0x144

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*client).tryRefreshMetadata()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/client.go:879 +0x17e

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.(*client).RefreshMetadata()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/client.go:489 +0x20f

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.NewClient()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/client.go:170 +0x476

[2022-04-01T02:48:49.891Z]   github.com/Shopify/sarama.NewClusterAdmin()

[2022-04-01T02:48:49.891Z]       /go/pkg/mod/github.com/!shopify/[email protected]/admin.go:148 +0x4e

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/pkg/kafka.NewSaramaAdminClient()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/kafka/cluster_admin_client.go:40 +0x64

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cdc/sink.newKafkaSaramaSink()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cdc/sink/mq.go:366 +0x21b

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cdc/sink.init.2.func3()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cdc/sink/sink.go:116 +0x8c

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cdc/sink.New()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cdc/sink/sink.go:143 +0x2b1

[2022-04-01T02:48:49.891Z]   github.com/pingcap/tiflow/cdc/sink.Validate()

[2022-04-01T02:48:49.891Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cdc/sink/sink.go:157 +0x144

[2022-04-01T02:48:49.892Z]   github.com/pingcap/tiflow/pkg/cmd/cli.(*createChangefeedOptions).validateSink()

[2022-04-01T02:48:49.892Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/cmd/cli/cli_changefeed_create.go:381 +0x98

[2022-04-01T02:48:49.892Z]   github.com/pingcap/tiflow/pkg/cmd/cli.(*createChangefeedOptions).run()

[2022-04-01T02:48:49.892Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/cmd/cli/cli_changefeed_create.go:436 +0x6b8

[2022-04-01T02:48:49.892Z]   github.com/pingcap/tiflow/pkg/cmd/cli.newCmdCreateChangefeed.func1()

[2022-04-01T02:48:49.892Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/cmd/cli/cli_changefeed_create.go:479 +0x151

[2022-04-01T02:48:49.892Z]   github.com/spf13/cobra.(*Command).execute()

[2022-04-01T02:48:49.892Z]       /go/pkg/mod/github.com/spf13/[email protected]/command.go:856 +0xad7

[2022-04-01T02:48:49.892Z]   github.com/spf13/cobra.(*Command).ExecuteC()

[2022-04-01T02:48:49.892Z]       /go/pkg/mod/github.com/spf13/[email protected]/command.go:974 +0x5c9

[2022-04-01T02:48:49.892Z]   github.com/spf13/cobra.(*Command).Execute()

[2022-04-01T02:48:49.892Z]       /go/pkg/mod/github.com/spf13/[email protected]/command.go:902 +0x2fd

[2022-04-01T02:48:49.892Z]   github.com/pingcap/tiflow/pkg/cmd.Run()

[2022-04-01T02:48:49.892Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/pkg/cmd/cmd.go:50 +0x300

[2022-04-01T02:48:49.892Z]   github.com/pingcap/tiflow/cmd/cdc.main()

[2022-04-01T02:48:49.892Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cmd/cdc/main.go:27 +0x33

[2022-04-01T02:48:49.892Z]   github.com/pingcap/tiflow/cmd/cdc.TestRunMain()

[2022-04-01T02:48:49.892Z]       /home/jenkins/agent/workspace/cdc_ghpr_kafka_integration_test/go/src/github.com/pingcap/tiflow/cmd/cdc/main_test.go:35 +0xca

[2022-04-01T02:48:49.892Z]   testing.tRunner()

[2022-04-01T02:48:49.892Z]       /usr/local/go/src/testing/testing.go:1439 +0x213

[2022-04-01T02:48:49.892Z]   testing.(*T).Run.func1()

[2022-04-01T02:48:49.892Z]       /usr/local/go/src/testing/testing.go:1486 +0x47

[2022-04-01T02:48:49.892Z] ==================

[2022-04-01T02:48:49.892Z] Create changefeed successfully!

[2022-04-01T02:48:49.892Z] ID: custom-changefeed-name

[2022-04-01T02:48:49.892Z] Info: {"sink-uri":"kafka://127.0.0.1:9092/ticdc-cli-test-16814?protocol=open-protocol\u0026partition-num=4\u0026kafka-version=2.4.1\u0026max-message-bytes=10485760","opts":{},"create-time":"2022-04-01T10:48:49.704160167+08:00","start-ts":432218131581632513,"target-ts":0,"admin-job-type":0,"sort-engine":"memory","sort-dir":"","config":{"case-sensitive":true,"enable-old-value":true,"force-replicate":false,"check-gc-safe-point":true,"filter":{"rules":["*.*"],"ignore-txn-start-ts":null},"mounter":{"worker-num":16},"sink":{"dispatchers":null,"protocol":"open-protocol","column-selectors":null},"cyclic-replication":{"enable":false,"replica-id":0,"filter-replica-ids":null,"id-buckets":0,"sync-ddl":false},"scheduler":{"type":"table-number","polling-time":-1},"consistent":{"level":"none","max-log-size":64,"flush-interval":1000,"storage":""}},"state":"normal","error":null,"sync-point-enabled":false,"sync-point-interval":600000000000,"creator-version":"v6.1.0-alpha-51-g448da119"}

[2022-04-01T02:48:49.892Z] --- FAIL: TestRunMain (0.48s)

[2022-04-01T02:48:49.892Z]     testing.go:1312: race detected during execution of test

[2022-04-01T02:48:49.892Z] FAIL

[2022-04-01T02:48:50.454Z] coverage: 3.3% of statements in github.com/pingcap/tiflow/...

[2022-04-01T02:49:12.367Z] make: *** [integration_test_kafka] Error 1

https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10320/pipeline

Anything else we need to know

  • Does this test exist for other branches as well?

  • Has there been a high frequency of failure lately?
@Rustin170506 Rustin170506 added component/test Unit tests and integration tests component. area/ticdc Issues or PRs related to TiCDC. labels Apr 1, 2022
@Rustin170506 Rustin170506 mentioned this issue Apr 1, 2022
Closed
@Rustin170506
Copy link
Member Author

another case: https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10333/pipeline

@3AceShowHand
Copy link
Contributor

it looks caused by bump sarama from 1.27.2 to 1.32.0

@3AceShowHand
Copy link
Contributor

IBM/sarama#2171

This was referenced Apr 2, 2022
Closed
Merged
@Rustin170506 Rustin170506 added type/bug The issue is confirmed as a bug. severity/minor labels Apr 5, 2022
@Rustin170506
Copy link
Member Author

another case:
https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_kafka_integration_test/detail/cdc_ghpr_kafka_integration_test/10394/pipeline

ti-chi-bot pushed a commit that referenced this issue Apr 7, 2022
@3AceShowHand
consumer(cdc): fix unstable test move_table (#5086)
361aa92 
close #2887, close #5090, close #5101
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/ticdc Issues or PRs related to TiCDC. component/test Unit tests and integration tests component. severity/minor type/bug The issue is confirmed as a bug.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

consumer(cdc): fix unstable test move_table 3AceShowHand/tiflow
2 participants
@3AceShowHand @Rustin170506