Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

changefeedccl: improve parquet performance #97068

Closed
amruss opened this issue Feb 13, 2023 · 2 comments
Closed

changefeedccl: improve parquet performance #97068

amruss opened this issue Feb 13, 2023 · 2 comments
Assignees
@jayshrivastava
Labels
A-cdc Change Data Capture C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) T-cdc

Comments

@amruss
Copy link
Contributor

amruss commented Feb 13, 2023 •
edited by shermanCRL
Loading

Improve parquet file format throughput ahead of the 23.1 release.

Possible things to improve:

  • add parallel encoding
  • change library we're using

Jira issue: CRDB-27372

Epic CRDB-15071
@amruss amruss added C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) A-cdc Change Data Capture T-cdc labels Feb 13, 2023
@blathers-crl
Copy link

blathers-crl bot commented Feb 13, 2023

cc @cockroachdb/cdc

@jayshrivastava
Copy link
Contributor

Closing in favor of #106591. #99028 is the issue which tracks adding the new library, which has been completed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jayshrivastava jayshrivastava

Labels
A-cdc Change Data Capture C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) T-cdc
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@amruss @jayshrivastava