Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

drainer error #7699

Closed
sakufo opened this issue Sep 14, 2018 · 3 comments
Closed

drainer error #7699

sakufo opened this issue Sep 14, 2018 · 3 comments
Assignees
Labels
type/question The issue belongs to a question.

Comments

@sakufo
Copy link

sakufo commented Sep 14, 2018

启动drainer提示以下错误,请问如何解决。
2018/09/14 14:25:05 offset_seeker.go:82: [info] kafka consumer version 0.8.2.0
2018/09/14 14:25:05 client.go:115: [sarama] Initializing new client
2018/09/14 14:25:05 config.go:351: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/14 14:25:05 config.go:351: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/14 14:25:05 client.go:646: [sarama] client/metadata fetching metadata for all topics from broker 10.10.10.8:9092
2018/09/14 14:25:05 broker.go:146: [sarama] Connected to broker at 10.10.10.8:9092 (unregistered)
2018/09/14 14:25:05 client.go:429: [sarama] client/brokers registered new broker #2 at 10.10.10.8:9092
2018/09/14 14:25:05 client.go:429: [sarama] client/brokers registered new broker #1 at 10.10.10.3:9092
2018/09/14 14:25:05 client.go:429: [sarama] client/brokers registered new broker #0 at 10.10.10.11:9092
2018/09/14 14:25:05 client.go:161: [sarama] Successfully initialized new client
2018/09/14 14:25:05 client.go:115: [sarama] Initializing new client
2018/09/14 14:25:05 config.go:351: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/14 14:25:05 config.go:351: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/14 14:25:05 client.go:646: [sarama] client/metadata fetching metadata for all topics from broker 10.10.10.8:9092
2018/09/14 14:25:05 broker.go:146: [sarama] Connected to broker at 10.10.10.8:9092 (unregistered)
2018/09/14 14:25:05 client.go:429: [sarama] client/brokers registered new broker #2 at 10.10.10.8:9092
2018/09/14 14:25:05 client.go:429: [sarama] client/brokers registered new broker #1 at 10.10.10.3:9092
2018/09/14 14:25:05 client.go:429: [sarama] client/brokers registered new broker #0 at 10.10.10.11:9092
2018/09/14 14:25:05 client.go:161: [sarama] Successfully initialized new client
2018/09/14 14:25:05 syncer.go:115: [info] [prepare] begin to construct schema infomation in syncer
2018/09/14 14:25:15 collector.go:365: [info] commit ts 0's safe commit ts is 0
2018/09/14 14:25:15 config.go:351: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/14 14:25:15 broker.go:144: [sarama] Connected to broker at 10.10.10.11:9092 (registered as #0)
2018/09/14 14:25:15 offset.go:115: [info] seek position 0 in topic 6600878647361733047_tp_8250 partition 0, oldest offset 0, newest offset 908
2018/09/14 14:25:15 config.go:351: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/14 14:25:15 broker.go:144: [sarama] Connected to broker at 10.10.10.11:9092 (registered as #0)
2018/09/14 14:25:15 consumer.go:738: [sarama] consumer/broker/0 added subscription to 6600878647361733047_tp_8250/0
2018/09/14 14:25:15 consumer.go:721: [sarama] consumer/broker/0 disconnecting due to error processing FetchRequest: kafka: error decoding packet: CRC didn't match expected 0x0 got 0xe38a6876
2018/09/14 14:25:15 broker.go:189: [sarama] Closed connection to broker 10.10.10.11:9092
2018/09/14 14:25:15 consumer.go:330: [sarama] kafka: error while consuming 6600878647361733047_tp_8250/0: kafka: error decoding packet: CRC didn't match expected 0x0 got 0xe38a6876
2018/09/14 14:25:17 consumer.go:345: [sarama] consumer/6600878647361733047_tp_8250/0 finding new broker
2018/09/14 14:25:17 client.go:644: [sarama] client/metadata fetching metadata for [6600878647361733047_tp_8250] from broker 10.10.10.8:9092
2018/09/14 14:25:17 config.go:351: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/14 14:25:17 consumer.go:738: [sarama] consumer/broker/0 added subscription to 6600878647361733047_tp_8250/0
2018/09/14 14:25:17 broker.go:144: [sarama] Connected to broker at 10.10.10.11:9092 (registered as #0)
2018/09/14 14:25:17 consumer.go:721: [sarama] consumer/broker/0 disconnecting due to error processing FetchRequest: kafka: error decoding packet: CRC didn't match expected 0x0 got 0xe38a6876
2018/09/14 14:25:17 broker.go:189: [sarama] Closed connection to broker 10.10.10.11:9092
2018/09/14 14:25:17 consumer.go:330: [sarama] kafka: error while consuming 6600878647361733047_tp_8250/0: kafka: error decoding packet: CRC didn't match expected 0x0 got 0xe38a6876

@shenli shenli assigned huachaohuang and july2993 and unassigned huachaohuang Sep 14, 2018
@shenli shenli added the type/question The issue belongs to a question. label Sep 14, 2018
@july2993
Copy link
Contributor

look like you are using kafka 2.0?, drainer don't support 2.0 now, you can use version 1.*, we may update to support 2.0 later

@kolbe
Copy link
Contributor

kolbe commented May 15, 2019

@july2993 is support for only Kafka 1.* still an issue in TiDB-Binlog?

@kolbe
Copy link
Contributor

kolbe commented May 15, 2019

I'm told that the Kafka drainer does now support Kafka 2.0, so I'm going to close this issue now. If you encounter additional problems, please open a new issue!

@kolbe kolbe closed this as completed May 15, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/question The issue belongs to a question.
Projects
None yet
Development

No branches or pull requests

5 participants