Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unit test kafkaSuite .TestSaramaProducer unstable #2314

Closed
amyangfei opened this issue Jul 18, 2021 · 3 comments
Closed

unit test kafkaSuite .TestSaramaProducer unstable #2314

amyangfei opened this issue Jul 18, 2021 · 3 comments
Assignees
Labels
area/ticdc Issues or PRs related to TiCDC. component/test Unit tests and integration tests component. difficulty/medium Medium task. severity/minor type/bug The issue is confirmed as a bug.

Comments

@amyangfei
Copy link
Contributor

Bug Report

Please answer these questions before submitting your issue. Thanks!

  1. What did you do? If possible, provide a recipe for reproducing the error.
[2021-07-17T14:35:00.291Z] panic: test timed out after 10m0s
[2021-07-17T14:35:00.291Z] 
[2021-07-17T14:35:00.291Z] goroutine 370 [running]:
[2021-07-17T14:35:00.291Z] testing.(*M).startAlarm.func1()
[2021-07-17T14:35:00.291Z] 	/usr/local/go/src/testing/testing.go:1700 +0x11f
[2021-07-17T14:35:00.291Z] created by time.goFunc
[2021-07-17T14:35:00.291Z] 	/usr/local/go/src/time/sleep.go:180 +0x52
[2021-07-17T14:35:00.291Z] 
[2021-07-17T14:35:00.291Z] goroutine 1 [chan receive, 10 minutes]:
[2021-07-17T14:35:00.291Z] testing.(*T).Run(0xc000001680, 0x2637fd9, 0x4, 0x26c7a98, 0x0)
[2021-07-17T14:35:00.291Z] 	/usr/local/go/src/testing/testing.go:1239 +0x610
[2021-07-17T14:35:00.291Z] testing.runTests.func1(0xc000001680)
[2021-07-17T14:35:00.291Z] 	/usr/local/go/src/testing/testing.go:1511 +0xa7
[2021-07-17T14:35:00.291Z] testing.tRunner(0xc000001680, 0xc000587c78)
[2021-07-17T14:35:00.291Z] 	/usr/local/go/src/testing/testing.go:1193 +0x203
[2021-07-17T14:35:00.291Z] testing.runTests(0xc0002bd4b8, 0x407eee0, 0x1, 0x1, 0xc034d881ce05f23f, 0x8bb80f1e39, 0x40f3be0, 0xc0001ac148)
[2021-07-17T14:35:00.291Z] 	/usr/local/go/src/testing/testing.go:1509 +0x613
[2021-07-17T14:35:00.291Z] testing.(*M).Run(0xc000029680, 0x0)
[2021-07-17T14:35:00.291Z] 	/usr/local/go/src/testing/testing.go:1417 +0x3b4
[2021-07-17T14:35:00.291Z] main.main()
[2021-07-17T14:35:00.292Z] 	_testmain.go:93 +0x357
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 88 [chan receive]:
[2021-07-17T14:35:00.292Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc0004e16b0)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/go.etcd.io/[email protected]/pkg/logutil/merge_logger.go:173 +0x4bb
[2021-07-17T14:35:00.292Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/go.etcd.io/[email protected]/pkg/logutil/merge_logger.go:91 +0x105
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 199 [chan receive, 10 minutes]:
[2021-07-17T14:35:00.292Z] github.com/Shopify/sarama.(*asyncProducer).retryHandler(0xc0001340e0)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:1034 +0x113
[2021-07-17T14:35:00.292Z] github.com/Shopify/sarama.withRecover(0xc000511010)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.292Z] created by github.com/Shopify/sarama.newAsyncProducer
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:167 +0x4de
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 198 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.292Z] github.com/Shopify/sarama.(*asyncProducer).dispatcher(0xc0001340e0)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:330 +0xfd
[2021-07-17T14:35:00.292Z] github.com/Shopify/sarama.withRecover(0xc000511000)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.292Z] created by github.com/Shopify/sarama.newAsyncProducer
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:166 +0x466
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 128 [chan receive]:
[2021-07-17T14:35:00.292Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc000518ae0)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/go.etcd.io/[email protected]/pkg/logutil/merge_logger.go:173 +0x4bb
[2021-07-17T14:35:00.292Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/go.etcd.io/[email protected]/pkg/logutil/merge_logger.go:91 +0x105
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 196 [chan receive, 10 minutes]:
[2021-07-17T14:35:00.292Z] github.com/Shopify/sarama.(*Broker).responseReceiver(0xc0001bb500)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:846 +0xbf
[2021-07-17T14:35:00.292Z] github.com/Shopify/sarama.withRecover(0xc000510fb0)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.292Z] created by github.com/Shopify/sarama.(*Broker).Open.func1
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:211 +0x107f
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 131 [chan receive]:
[2021-07-17T14:35:00.292Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc000518c18)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/go.etcd.io/[email protected]/pkg/logutil/merge_logger.go:173 +0x4bb
[2021-07-17T14:35:00.292Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/go.etcd.io/[email protected]/pkg/logutil/merge_logger.go:91 +0x105
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 195 [chan receive]:
[2021-07-17T14:35:00.292Z] github.com/rcrowley/go-metrics.(*meterArbiter).tick(0x40f3360)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/rcrowley/[email protected]/meter.go:239 +0x72
[2021-07-17T14:35:00.292Z] created by github.com/rcrowley/go-metrics.NewMeter
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/rcrowley/[email protected]/meter.go:46 +0x171
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 185 [select, 10 minutes]:
[2021-07-17T14:35:00.292Z] github.com/pingcap/check.(*suiteRunner).doRun(0xc000329950, 0x0)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/check.go:667 +0x225
[2021-07-17T14:35:00.292Z] github.com/pingcap/check.(*suiteRunner).run(0xc000329950, 0x4126060)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/check.go:696 +0x145
[2021-07-17T14:35:00.292Z] github.com/pingcap/check.Run(0x24a0f80, 0x4126060, 0xc0000d0e50, 0xba871b)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/run.go:150 +0x5b
[2021-07-17T14:35:00.292Z] github.com/pingcap/check.RunAll(0xc0001b5e50, 0x0)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/run.go:113 +0xff7
[2021-07-17T14:35:00.292Z] github.com/pingcap/check.TestingT(0xc000001800)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/run.go:99 +0x757
[2021-07-17T14:35:00.292Z] github.com/pingcap/ticdc/cdc/sink/producer/kafka.Test(0xc000001800)
[2021-07-17T14:35:00.292Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka_test.go:36 +0x39
[2021-07-17T14:35:00.292Z] testing.tRunner(0xc000001800, 0x26c7a98)
[2021-07-17T14:35:00.292Z] 	/usr/local/go/src/testing/testing.go:1193 +0x203
[2021-07-17T14:35:00.292Z] created by testing.(*T).Run
[2021-07-17T14:35:00.292Z] 	/usr/local/go/src/testing/testing.go:1238 +0x5d8
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 186 [select, 10 minutes]:
[2021-07-17T14:35:00.292Z] github.com/pingcap/check.(*resultTracker)._loopRoutine(0xc0003298c0)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/check.go:464 +0x185
[2021-07-17T14:35:00.292Z] created by github.com/pingcap/check.(*resultTracker).start
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/check.go:444 +0x4d
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 188 [chan receive, 10 minutes]:
[2021-07-17T14:35:00.292Z] github.com/Shopify/sarama.(*MockBroker).serverLoop.func1(0xc000029a80)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:161 +0x65
[2021-07-17T14:35:00.292Z] created by github.com/Shopify/sarama.(*MockBroker).serverLoop
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:160 +0xbf
[2021-07-17T14:35:00.292Z] 
[2021-07-17T14:35:00.292Z] goroutine 7 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.292Z] github.com/Shopify/sarama.(*syncProducer).SendMessages(0xc000518108, 0xc000617b30, 0x2, 0x2, 0x2, 0x43a900)
[2021-07-17T14:35:00.292Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/sync_producer.go:118 +0x145
[2021-07-17T14:35:00.293Z] github.com/pingcap/ticdc/cdc/sink/producer/kafka.(*kafkaSaramaProducer).SyncBroadcastMessage(0xc0004e2750, 0x2e43e58, 0xc00003de80, 0xc0003978b8, 0x0, 0x0)
[2021-07-17T14:35:00.293Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka.go:141 +0x6e2
[2021-07-17T14:35:00.293Z] github.com/pingcap/ticdc/cdc/sink/producer/kafka.(*kafkaSuite).TestSaramaProducer(0x4126060, 0xc0004cca50)
[2021-07-17T14:35:00.293Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka_test.go:159 +0x1471
[2021-07-17T14:35:00.293Z] reflect.Value.call(0x24a0f80, 0x4126060, 0xe13, 0x2637c95, 0x4, 0xc0000d7ef0, 0x1, 0x1, 0xc000539508, 0x1a7729e, ...)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/reflect/value.go:476 +0x99c
[2021-07-17T14:35:00.293Z] reflect.Value.Call(0x24a0f80, 0x4126060, 0xe13, 0xc0005396f0, 0x1, 0x1, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/reflect/value.go:337 +0xd9
[2021-07-17T14:35:00.293Z] github.com/pingcap/check.(*suiteRunner).forkTest.func1(0xc0004cca50)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/check.go:850 +0xb3c
[2021-07-17T14:35:00.293Z] github.com/pingcap/check.(*suiteRunner).forkCall.func1(0xc000329950, 0xc0004cca50, 0xc0000255a0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/check.go:739 +0x11e
[2021-07-17T14:35:00.293Z] created by github.com/pingcap/check.(*suiteRunner).forkCall
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/pingcap/[email protected]/check.go:734 +0x4cd
[2021-07-17T14:35:00.293Z] 
[2021-07-17T14:35:00.293Z] goroutine 10 [IO wait]:
[2021-07-17T14:35:00.293Z] internal/poll.runtime_pollWait(0x7f0af1d403b0, 0x72, 0x72)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/runtime/netpoll.go:222 +0x55
[2021-07-17T14:35:00.293Z] internal/poll.(*pollDesc).wait(0xc000029a18, 0x72, 0x0, 0x0, 0x263c26b)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0xe6
[2021-07-17T14:35:00.293Z] internal/poll.(*pollDesc).waitRead(...)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
[2021-07-17T14:35:00.293Z] internal/poll.(*FD).Accept(0xc000029a00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/internal/poll/fd_unix.go:401 +0x32f
[2021-07-17T14:35:00.293Z] net.(*netFD).accept(0xc000029a00, 0x0, 0xc0002b0e38, 0x4b6375)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/net/fd_unix.go:172 +0x58
[2021-07-17T14:35:00.293Z] net.(*TCPListener).accept(0xc000518030, 0x258c7a0, 0x7f0af1ba5fd8, 0x4bacf3)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/net/tcpsock_posix.go:139 +0x50
[2021-07-17T14:35:00.293Z] net.(*TCPListener).Accept(0xc000518030, 0x26c66a0, 0xc000029a80, 0x7f0af1ba5fd8, 0xc0001aa070)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/net/tcpsock.go:261 +0x8e
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.(*MockBroker).serverLoop(0xc000029a80)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:170 +0x214
[2021-07-17T14:35:00.293Z] created by github.com/Shopify/sarama.NewMockBrokerListener
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:408 +0x565
[2021-07-17T14:35:00.293Z] 
[2021-07-17T14:35:00.293Z] goroutine 197 [select, 10 minutes]:
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.(*client).backgroundMetadataUpdater(0xc0004e2630)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:809 +0x265
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.withRecover(0xc000510fe0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.293Z] created by github.com/Shopify/sarama.NewClient
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:180 +0x4a5
[2021-07-17T14:35:00.293Z] 
[2021-07-17T14:35:00.293Z] goroutine 12 [IO wait, 10 minutes]:
[2021-07-17T14:35:00.293Z] internal/poll.runtime_pollWait(0x7f0af1d402c8, 0x72, 0x3a8af30)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/runtime/netpoll.go:222 +0x55
[2021-07-17T14:35:00.293Z] internal/poll.(*pollDesc).wait(0xc000029b18, 0x72, 0x0, 0x4, 0xffffffffffffffff)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0xe6
[2021-07-17T14:35:00.293Z] internal/poll.(*pollDesc).waitRead(...)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
[2021-07-17T14:35:00.293Z] internal/poll.(*FD).Read(0xc000029b00, 0xc0004a4878, 0x4, 0x4, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/internal/poll/fd_unix.go:166 +0x28f
[2021-07-17T14:35:00.293Z] net.(*netFD).Read(0xc000029b00, 0xc0004a4878, 0x4, 0x4, 0x8, 0xc000113a58, 0x501605)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/net/fd_posix.go:55 +0x69
[2021-07-17T14:35:00.293Z] net.(*conn).Read(0xc000010678, 0xc0004a4878, 0x4, 0x4, 0x52, 0x0, 0x0)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/net/net.go:183 +0xec
[2021-07-17T14:35:00.293Z] io.ReadAtLeast(0x2e18d80, 0xc000010678, 0xc0004a4878, 0x4, 0x4, 0x4, 0x47f3dc, 0x43e1ff, 0xc0005a8000)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/io/io.go:328 +0x9d
[2021-07-17T14:35:00.293Z] io.ReadFull(...)
[2021-07-17T14:35:00.293Z] 	/usr/local/go/src/io/io.go:347
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.(*MockBroker).readToBytes(0xc000029a80, 0x2e18d80, 0xc000010678, 0x2e18d80, 0xc000010678, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:189 +0xb2
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.(*MockBroker).handleRequests(0xc000029a80, 0x7f0af1ba5fd8, 0xc000010678, 0x0, 0xc0004a46e0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:237 +0x33e
[2021-07-17T14:35:00.293Z] created by github.com/Shopify/sarama.(*MockBroker).serverLoop
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:172 +0x1e9
[2021-07-17T14:35:00.293Z] 
[2021-07-17T14:35:00.293Z] goroutine 13 [select, 10 minutes]:
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.(*MockBroker).handleRequests.func2(0xc000029a80, 0x7f0af1ba5fd8, 0xc000010678, 0xc0001904e0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:227 +0xc9
[2021-07-17T14:35:00.293Z] created by github.com/Shopify/sarama.(*MockBroker).handleRequests
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:226 +0x2e5
[2021-07-17T14:35:00.293Z] 
[2021-07-17T14:35:00.293Z] goroutine 16 [select, 10 minutes]:
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.(*client).backgroundMetadataUpdater(0xc000136000)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:809 +0x265
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.withRecover(0xc0004a9670)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.293Z] created by github.com/Shopify/sarama.NewClient
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:180 +0x4a5
[2021-07-17T14:35:00.293Z] 
[2021-07-17T14:35:00.293Z] goroutine 210 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.(*asyncProducer).dispatcher(0xc0002b77a0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:330 +0xfd
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.withRecover(0xc0004a96b0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.293Z] created by github.com/Shopify/sarama.newAsyncProducer
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:166 +0x466
[2021-07-17T14:35:00.293Z] 
[2021-07-17T14:35:00.293Z] goroutine 211 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.(*asyncProducer).retryHandler(0xc0002b77a0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:1034 +0x113
[2021-07-17T14:35:00.293Z] github.com/Shopify/sarama.withRecover(0xc0004a96e0)
[2021-07-17T14:35:00.293Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.newAsyncProducer
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:167 +0x4de
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 212 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*syncProducer).handleSuccesses(0xc000518108)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/sync_producer.go:131 +0x145
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.withRecover(0xc0004a96f0)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.newSyncProducerFromAsyncProducer
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/sync_producer.go:76 +0x131
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 213 [chan receive, 10 minutes]:
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*syncProducer).handleErrors(0xc000518108)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/sync_producer.go:139 +0x165
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.withRecover(0xc0004a9720)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.newSyncProducerFromAsyncProducer
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/sync_producer.go:77 +0x1ad
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 214 [select]:
[2021-07-17T14:35:00.294Z] github.com/pingcap/ticdc/pkg/notify.(*Receiver).signalTickLoop.func1(0xc000203ad0)
[2021-07-17T14:35:00.294Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/pkg/notify/notify.go:67 +0x11f
[2021-07-17T14:35:00.294Z] created by github.com/pingcap/ticdc/pkg/notify.(*Receiver).signalTickLoop
[2021-07-17T14:35:00.294Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/pkg/notify/notify.go:64 +0x4d
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 215 [select, 9 minutes]:
[2021-07-17T14:35:00.294Z] github.com/pingcap/ticdc/cdc/sink/producer/kafka.(*kafkaSaramaProducer).run(0xc0004e2750, 0x2e43e58, 0xc00003de80, 0x0, 0x0)
[2021-07-17T14:35:00.294Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka.go:239 +0x325
[2021-07-17T14:35:00.294Z] github.com/pingcap/ticdc/cdc/sink/producer/kafka.NewKafkaSaramaProducer.func1(0xc0004e2750, 0x2e43e58, 0xc00003de80, 0xc00052c900)
[2021-07-17T14:35:00.294Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka.go:365 +0x88
[2021-07-17T14:35:00.294Z] created by github.com/pingcap/ticdc/cdc/sink/producer/kafka.NewKafkaSaramaProducer
[2021-07-17T14:35:00.294Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka.go:364 +0x9a5
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 216 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*topicProducer).dispatch(0xc0001ae880)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:412 +0x9c
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.withRecover(0xc0004a9840)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.(*asyncProducer).newTopicProducer
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:407 +0x3a7
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 217 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*partitionProducer).dispatch(0xc00052d440)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:546 +0x21d
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.withRecover(0xc0004a9960)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.(*asyncProducer).newPartitionProducer
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:513 +0x3c7
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 218 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*partitionProducer).dispatch(0xc00052d500)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:546 +0x21d
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.withRecover(0xc0004a9970)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.(*asyncProducer).newPartitionProducer
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:513 +0x3c7
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 220 [select, 9 minutes]:
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*brokerProducer).run(0xc0002b7880)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:747 +0x388
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.withRecover(0xc0004a99c0)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:691 +0x4a7
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 221 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer.func1()
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:695 +0xa5
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.withRecover(0xc000025800)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:694 +0x594
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 153 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*Broker).responseReceiver(0xc000308e00)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:846 +0xbf
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.withRecover(0xc000540190)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.(*Broker).Open.func1
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:211 +0x107f
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.294Z] goroutine 223 [IO wait, 9 minutes]:
[2021-07-17T14:35:00.294Z] internal/poll.runtime_pollWait(0x7f0af1d3fe40, 0x72, 0x3a8af30)
[2021-07-17T14:35:00.294Z] 	/usr/local/go/src/runtime/netpoll.go:222 +0x55
[2021-07-17T14:35:00.294Z] internal/poll.(*pollDesc).wait(0xc000029d18, 0x72, 0x0, 0x4, 0xffffffffffffffff)
[2021-07-17T14:35:00.294Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0xe6
[2021-07-17T14:35:00.294Z] internal/poll.(*pollDesc).waitRead(...)
[2021-07-17T14:35:00.294Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
[2021-07-17T14:35:00.294Z] internal/poll.(*FD).Read(0xc000029d00, 0xc0000439e8, 0x4, 0x4, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.294Z] 	/usr/local/go/src/internal/poll/fd_unix.go:166 +0x28f
[2021-07-17T14:35:00.294Z] net.(*netFD).Read(0xc000029d00, 0xc0000439e8, 0x4, 0x4, 0x8, 0xc00054fa58, 0x501605)
[2021-07-17T14:35:00.294Z] 	/usr/local/go/src/net/fd_posix.go:55 +0x69
[2021-07-17T14:35:00.294Z] net.(*conn).Read(0xc0000106b8, 0xc0000439e8, 0x4, 0x4, 0x31, 0x0, 0x0)
[2021-07-17T14:35:00.294Z] 	/usr/local/go/src/net/net.go:183 +0xec
[2021-07-17T14:35:00.294Z] io.ReadAtLeast(0x2e18d80, 0xc0000106b8, 0xc0000439e8, 0x4, 0x4, 0x4, 0x47f3dc, 0x43e1ff, 0xc0005a8000)
[2021-07-17T14:35:00.294Z] 	/usr/local/go/src/io/io.go:328 +0x9d
[2021-07-17T14:35:00.294Z] io.ReadFull(...)
[2021-07-17T14:35:00.294Z] 	/usr/local/go/src/io/io.go:347
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*MockBroker).readToBytes(0xc000029a80, 0x2e18d80, 0xc0000106b8, 0x2e18d80, 0xc0000106b8, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:189 +0xb2
[2021-07-17T14:35:00.294Z] github.com/Shopify/sarama.(*MockBroker).handleRequests(0xc000029a80, 0x7f0af1ba5fd8, 0xc0000106b8, 0x2, 0xc0004a46e0)
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:237 +0x33e
[2021-07-17T14:35:00.294Z] created by github.com/Shopify/sarama.(*MockBroker).serverLoop
[2021-07-17T14:35:00.294Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:172 +0x1e9
[2021-07-17T14:35:00.294Z] 
[2021-07-17T14:35:00.295Z] goroutine 224 [select, 10 minutes]:
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*MockBroker).handleRequests.func2(0xc000029a80, 0x7f0af1ba5fd8, 0xc0000106b8, 0xc00039bec0)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:227 +0xc9
[2021-07-17T14:35:00.295Z] created by github.com/Shopify/sarama.(*MockBroker).handleRequests
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:226 +0x2e5
[2021-07-17T14:35:00.295Z] 
[2021-07-17T14:35:00.295Z] goroutine 225 [select]:
[2021-07-17T14:35:00.295Z] github.com/pingcap/ticdc/cdc/sink/producer/kafka.(*kafkaSuite).TestSaramaProducer.func3(0xc000148880, 0x2e43e58, 0xc00003de80, 0xc0004e2750)
[2021-07-17T14:35:00.295Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka_test.go:131 +0x1a5
[2021-07-17T14:35:00.295Z] created by github.com/pingcap/ticdc/cdc/sink/producer/kafka.(*kafkaSuite).TestSaramaProducer
[2021-07-17T14:35:00.295Z] 	/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka_test.go:128 +0xf85
[2021-07-17T14:35:00.295Z] 
[2021-07-17T14:35:00.295Z] goroutine 227 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*topicProducer).dispatch(0xc00064ecc0)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:412 +0x9c
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.withRecover(0xc000617b50)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.295Z] created by github.com/Shopify/sarama.(*asyncProducer).newTopicProducer
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:407 +0x3a7
[2021-07-17T14:35:00.295Z] 
[2021-07-17T14:35:00.295Z] goroutine 228 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*partitionProducer).dispatch(0xc00064c540)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:546 +0x21d
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.withRecover(0xc000617b60)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.295Z] created by github.com/Shopify/sarama.(*asyncProducer).newPartitionProducer
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:513 +0x3c7
[2021-07-17T14:35:00.295Z] 
[2021-07-17T14:35:00.295Z] goroutine 229 [select]:
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*Broker).sendAndReceive(0xc000309500, 0x2e4e5a0, 0xc000650300, 0x2e4e5e8, 0xc00001e6e0, 0x441e38, 0x28)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:774 +0x1e5
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*Broker).GetMetadata(0xc000309500, 0xc000650300, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:283 +0x7e
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x65, 0x0, 0x0, 0x0, 0x0, 0xc00059fc20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:880 +0x6cb
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x66, 0x0, 0x0, 0x0, 0x0, 0xc00059fc20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x67, 0x0, 0x0, 0x0, 0x0, 0xc00059fc20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x68, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x69, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x6a, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x6b, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x6c, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x6d, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x6e, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x6f, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x70, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x71, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.295Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x72, 0x0, 0x0, 0x0, 0x0, 0xc000177c20)
[2021-07-17T14:35:00.295Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x73, 0x0, 0x0, 0x0, 0x0, 0xc000551c20)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x74, 0x0, 0x0, 0x0, 0x0, 0xc000551c20)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x75, 0x0, 0x0, 0x0, 0x0, 0xc000551c20)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x76, 0x0, 0x0, 0x0, 0x0, 0xc000551c20)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x77, 0x0, 0x0, 0x0, 0x0, 0xc000551c20)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata.func2(0x2e172c0, 0xc00019aae0, 0x1, 0x1)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:859 +0x399
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).tryRefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x78, 0x0, 0x0, 0x0, 0x7f0af28d4108, 0x10)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:927 +0x12d6
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*client).RefreshMetadata(0xc000136000, 0xc00031d2a0, 0x1, 0x1, 0x7f0ac1990008, 0xc0002b77f8)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/client.go:473 +0x1d2
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*partitionProducer).updateLeader.func1(0xc0002aec20, 0xc0002aecb8)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:657 +0x14a
[2021-07-17T14:35:00.296Z] github.com/eapache/go-resiliency/breaker.(*Breaker).doWork.func1(0xc0002aecb8, 0xc0002aed58, 0x0, 0x0)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/eapache/[email protected]/breaker/breaker.go:85 +0x74
[2021-07-17T14:35:00.296Z] github.com/eapache/go-resiliency/breaker.(*Breaker).doWork(0xc0006540f0, 0x0, 0xc0002aed58, 0x4a4a52, 0x26c9a50)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/eapache/[email protected]/breaker/breaker.go:86 +0x4f
[2021-07-17T14:35:00.296Z] github.com/eapache/go-resiliency/breaker.(*Breaker).Run(0xc0006540f0, 0xc0002aed58, 0x1dcd6500, 0xc00064c640)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/eapache/[email protected]/breaker/breaker.go:55 +0xaf
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*partitionProducer).updateLeader(0xc00064c600, 0x1, 0xc00057be01)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:656 +0x78
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*partitionProducer).dispatch(0xc00064c600)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:589 +0x608
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.withRecover(0xc000617b70)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.296Z] created by github.com/Shopify/sarama.(*asyncProducer).newPartitionProducer
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:513 +0x3c7
[2021-07-17T14:35:00.296Z] 
[2021-07-17T14:35:00.296Z] goroutine 231 [select, 9 minutes]:
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*brokerProducer).run(0xc0002c1570)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:747 +0x388
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.withRecover(0xc000617b90)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.296Z] created by github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:691 +0x4a7
[2021-07-17T14:35:00.296Z] 
[2021-07-17T14:35:00.296Z] goroutine 232 [chan receive, 9 minutes]:
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer.func1()
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:695 +0xa5
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.withRecover(0xc00063f760)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.296Z] created by github.com/Shopify/sarama.(*asyncProducer).newBrokerProducer
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/async_producer.go:694 +0x594
[2021-07-17T14:35:00.296Z] 
[2021-07-17T14:35:00.296Z] goroutine 359 [IO wait]:
[2021-07-17T14:35:00.296Z] internal/poll.runtime_pollWait(0x7f0af1d3fc70, 0x72, 0x3a8af30)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/runtime/netpoll.go:222 +0x55
[2021-07-17T14:35:00.296Z] internal/poll.(*pollDesc).wait(0xc000554318, 0x72, 0x1000, 0x1000, 0xffffffffffffffff)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0xe6
[2021-07-17T14:35:00.296Z] internal/poll.(*pollDesc).waitRead(...)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
[2021-07-17T14:35:00.296Z] internal/poll.(*FD).Read(0xc000554300, 0xc000364000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/internal/poll/fd_unix.go:166 +0x28f
[2021-07-17T14:35:00.296Z] net.(*netFD).Read(0xc000554300, 0xc000364000, 0x1000, 0x1000, 0x23d4de0, 0x7f0af1d3fd50, 0x27)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/net/fd_posix.go:55 +0x69
[2021-07-17T14:35:00.296Z] net.(*conn).Read(0xc00030e1b8, 0xc000364000, 0x1000, 0x1000, 0x0, 0x0, 0x6fc23496c)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/net/net.go:183 +0xec
[2021-07-17T14:35:00.296Z] bufio.(*Reader).Read(0xc00064d320, 0xc00053e110, 0x8, 0x8, 0xc034d8845e91bc4c, 0x8e1ca6cc8a, 0x40f3be0)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/bufio/bufio.go:227 +0x7ba
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*bufConn).Read(0xc0004e0ac8, 0xc00053e110, 0x8, 0x8, 0xc0002b1d40, 0x43f605, 0x240c5c0)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:107 +0x75
[2021-07-17T14:35:00.296Z] io.ReadAtLeast(0x7f0af1ba6008, 0xc0004e0ac8, 0xc00053e110, 0x8, 0x8, 0x8, 0x40f3be0, 0xc00053e110, 0xc000100400)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/io/io.go:328 +0x9d
[2021-07-17T14:35:00.296Z] io.ReadFull(...)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/io/io.go:347
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*Broker).readFull(0xc000309500, 0xc00053e110, 0x8, 0x8, 0x439185, 0xc000531b00, 0x4)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:702 +0x218
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.(*Broker).responseReceiver(0xc000309500)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:858 +0x1ba
[2021-07-17T14:35:00.296Z] github.com/Shopify/sarama.withRecover(0xc000540290)
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/utils.go:43 +0x5b
[2021-07-17T14:35:00.296Z] created by github.com/Shopify/sarama.(*Broker).Open.func1
[2021-07-17T14:35:00.296Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/broker.go:211 +0x107f
[2021-07-17T14:35:00.296Z] 
[2021-07-17T14:35:00.296Z] goroutine 341 [IO wait]:
[2021-07-17T14:35:00.296Z] internal/poll.runtime_pollWait(0x7f0af1d3fd58, 0x72, 0x3a8af30)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/runtime/netpoll.go:222 +0x55
[2021-07-17T14:35:00.296Z] internal/poll.(*pollDesc).wait(0xc0002bb798, 0x72, 0x0, 0x4, 0xffffffffffffffff)
[2021-07-17T14:35:00.296Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0xe6
[2021-07-17T14:35:00.296Z] internal/poll.(*pollDesc).waitRead(...)
[2021-07-17T14:35:00.297Z] 	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
[2021-07-17T14:35:00.297Z] internal/poll.(*FD).Read(0xc0002bb780, 0xc000042864, 0x4, 0x4, 0x0, 0x0, 0x0)
[2021-07-17T14:35:00.297Z] 	/usr/local/go/src/internal/poll/fd_unix.go:166 +0x28f
[2021-07-17T14:35:00.297Z] net.(*netFD).Read(0xc0002bb780, 0xc000042864, 0x4, 0x4, 0x34330000, 0xa, 0x486de0)
[2021-07-17T14:35:00.297Z] 	/usr/local/go/src/net/fd_posix.go:55 +0x69
[2021-07-17T14:35:00.297Z] net.(*conn).Read(0xc0001aa070, 0xc000042864, 0x4, 0x4, 0xc00018e2d0, 0xc00027a500, 0x17c)
[2021-07-17T14:35:00.297Z] 	/usr/local/go/src/net/net.go:183 +0xec
[2021-07-17T14:35:00.297Z] io.ReadAtLeast(0x2e18d80, 0xc0001aa070, 0xc000042864, 0x4, 0x4, 0x4, 0xc00018e2d0, 0x43e1ff, 0xc0005a8000)
[2021-07-17T14:35:00.297Z] 	/usr/local/go/src/io/io.go:328 +0x9d
[2021-07-17T14:35:00.297Z] io.ReadFull(...)
[2021-07-17T14:35:00.297Z] 	/usr/local/go/src/io/io.go:347
[2021-07-17T14:35:00.297Z] github.com/Shopify/sarama.(*MockBroker).readToBytes(0xc000029a80, 0x2e18d80, 0xc0001aa070, 0x2e18d80, 0xc0001aa070, 0x3, 0x0, 0x0)
[2021-07-17T14:35:00.297Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:189 +0xb2
[2021-07-17T14:35:00.297Z] github.com/Shopify/sarama.(*MockBroker).handleRequests(0xc000029a80, 0x7f0af1ba5fd8, 0xc0001aa070, 0x16, 0xc0004a46e0)
[2021-07-17T14:35:00.297Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:237 +0x33e
[2021-07-17T14:35:00.297Z] created by github.com/Shopify/sarama.(*MockBroker).serverLoop
[2021-07-17T14:35:00.297Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:172 +0x1e9
[2021-07-17T14:35:00.297Z] 
[2021-07-17T14:35:00.297Z] goroutine 342 [select]:
[2021-07-17T14:35:00.297Z] github.com/Shopify/sarama.(*MockBroker).handleRequests.func2(0xc000029a80, 0x7f0af1ba5fd8, 0xc0001aa070, 0xc0004ac1e0)
[2021-07-17T14:35:00.297Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:227 +0xc9
[2021-07-17T14:35:00.297Z] created by github.com/Shopify/sarama.(*MockBroker).handleRequests
[2021-07-17T14:35:00.297Z] 	/nfs/cache/mod/github.com/!shopify/[email protected]/mockbroker.go:226 +0x2e5
[2021-07-17T14:35:00.297Z] FAIL	github.com/pingcap/ticdc/cdc/sink/producer/kafka	600.130s
  1. Versions of the cluster

    • TiCDC version (execute cdc version):

      master@bb23408

@amyangfei amyangfei added the type/bug The issue is confirmed as a bug. label Jul 18, 2021
@asddongmen asddongmen added the component/test Unit tests and integration tests component. label Jul 27, 2021
@amyangfei amyangfei added the difficulty/medium Medium task. label Aug 27, 2021
@Rustin170506
Copy link
Member

It doesn't seem to be happening again, close it for now. If you guys still encounter it please give feedback and turn it back on.

@overvenus
Copy link
Member

Found a new case, it's now reports "[CDC:ErrKafkaFlushUnfinished]flush not finished before producer close"

[2021-12-17T10:28:44.846Z] [2021/12/17 18:26:14.862 +08:00] [ERROR] [kafka.go:344] ["close async client with error"] [error="kafka: Failed to deliver 1 messages."] [stack="github.com/pingcap/ticdc/cdc/sink/producer/kafka.(*kafkaSaramaProducer).Close\n\t/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka.go:344\ngithub.com/pingcap/ticdc/cdc/sink/producer/kafka.(*kafkaSuite).TestProducerSendMessageFailed.func3\n\t/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka_test.go:396\ngithub.com/pingcap/ticdc/cdc/sink/producer/kafka.(*kafkaSuite).TestProducerSendMessageFailed\n\t/home/jenkins/agent/workspace/cdc_ghpr_test/go/src/github.com/pingcap/ticdc/cdc/sink/producer/kafka/kafka_test.go:429\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:460\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:321\ngithub.com/pingcap/check.(*suiteRunner).forkTest.func1\n\t/go/pkg/mod/github.com/pingcap/[email protected]/check.go:850\ngithub.com/pingcap/check.(*suiteRunner).forkCall.func1\n\t/go/pkg/mod/github.com/pingcap/[email protected]/check.go:739"]
[2021-12-17T10:28:44.846Z] 
[2021-12-17T10:28:44.846Z] ----------------------------------------------------------------------
[2021-12-17T10:28:44.846Z] FAIL: kafka_test.go:101: kafkaSuite.TestSaramaProducer
[2021-12-17T10:28:44.846Z] 
[2021-12-17T10:28:44.846Z] kafka_test.go:177:
[2021-12-17T10:28:44.846Z]     c.Assert(err, check.IsNil)
[2021-12-17T10:28:44.846Z] ... value *errors.withStack = [CDC:ErrKafkaFlushUnfinished]flush not finished before producer close ("[CDC:ErrKafkaFlushUnfinished]flush not finished before producer close")
[2021-12-17T10:28:44.846Z] 
[2021-12-17T10:28:44.846Z] OOPS: 8 passed, 1 FAILED

https://ci2.pingcap.net/blue/organizations/jenkins/cdc_ghpr_test/detail/cdc_ghpr_test/13801/pipeline#step-55-log-35

Tested in #3942

@overvenus overvenus reopened this Dec 17, 2021
@jebter jebter added the area/ticdc Issues or PRs related to TiCDC. label Dec 29, 2021
@Rustin170506
Copy link
Member

It doesn't seem to be happening again, close it for now. If you guys still encounter it please give feedback and turn it back on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ticdc Issues or PRs related to TiCDC. component/test Unit tests and integration tests component. difficulty/medium Medium task. severity/minor type/bug The issue is confirmed as a bug.
Projects
None yet
Development

No branches or pull requests

6 participants