Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support null as a valid primary key value #352

Merged
merged 1 commit into from
Sep 12, 2024
Merged

Conversation

raghumdani
Copy link
Collaborator

This PR supports tables with null primary keys. We observed one table had null primary key and the schema specifying primary key can be null. This breaks the primary key definition. However, in the short term we will follow spark compaction behavior and in the long term we will rollback to the current behavior where it's not supported.

@raghumdani raghumdani marked this pull request as ready for review September 12, 2024 20:42
Copy link
Member

@Zyiqin-Miranda Zyiqin-Miranda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix, the test cases are very thorough.

@raghumdani raghumdani merged commit 71026ef into main Sep 12, 2024
3 checks passed
@raghumdani raghumdani deleted the null-pk-support branch September 12, 2024 23:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants