Skip to content

CDC-to-Kafka 4.1.2
Compare
Choose a tag to compare
@woodlee woodlee released this 29 Apr 14:41
· 2 commits to master since this release
v4.1.2
bcc15d7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

This release contains various stability and performance improvements:

  1. Switches from multiprocessing to multithreading, eliminating slowdowns due to Pickle (de)serialization.
  2. Ensures that Kafka consumers are closed immediately after use, to prevent delayed exceptions due to OAuth expiration.
  3. Gives librdkafka more time to destroy its objects at shutdown, to prevent exit-time hangs.
  4. Reduces the number of no-op Kafka transactions used.
  5. Tighter/faster looping over the specific table(s) that are falling behind whenever lag occurs due to high change data volume.
  6. Adds a local-file metrics reporter class, which can be used for e.g. Kubernetes liveness probes.
  7. Some bugfixes for the separate example replayer.py consumer script.
  8. The show_snapshot_history.py script/tool can now handle multiple tables per invocation.
  9. Fixes a KeyError that could occur in cases where a re-snapshot of an existing but altered table is being skipped.
Assets 2
Loading