-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Core: Add StandardEncryptionManager #9277
Conversation
Co-Authored-By: Jian Tang <[email protected]>
|
||
if (FileFormat.fromString(fileFormat) != FileFormat.PARQUET) { | ||
throw new UnsupportedOperationException( | ||
"Iceberg encryption currently supports only parquet format for data files"); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: Maybe, "Iceberg encryption for data files currently only supports parquet, default file format of $format is set as $DEFAULT_FILE_FORMAT""
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We're going to remove this anyway in the next PR since it doesn't actually prevent writing Avro or ORC files with encryption turned on.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me, tiny nit on the error message for invalid default data file format.
Thanks for the final review, @RussellSpitzer! |
Co-Authored-By: Jian Tang <[email protected]> Co-authored-by: Gidon Gershinsky <[email protected]>
Co-Authored-By: Jian Tang <[email protected]> Co-authored-by: Gidon Gershinsky <[email protected]>
Co-Authored-By: Jian Tang <[email protected]> Co-authored-by: Gidon Gershinsky <[email protected]>
This is an update to #6884 with a few final fixes to the
StandardEncryptionManager
and related classes. This is almost entirely @ggershinsky's work, I'm just submitting this to unblock merging since he's OOO right now.