Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize data file conversions in Iceberg and Hudi target clients #329

Closed
ashvina opened this issue Feb 11, 2024 · 0 comments · Fixed by #330
Closed

Optimize data file conversions in Iceberg and Hudi target clients #329

ashvina opened this issue Feb 11, 2024 · 0 comments · Fixed by #330
Assignees
Labels
good first issue Good for newcomers

Comments

@ashvina
Copy link
Contributor

ashvina commented Feb 11, 2024

To avoid creating unnecessary object creation and converting data files multiple times, Iceberg and Hudi clients should follow the same approach as the Delta Client.

Do we want to do something similar for Iceberg and Hudi targets? Is there any way we can make this logic common?

Originally posted by @the-other-tim-brown in #326 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant