-
Notifications
You must be signed in to change notification settings - Fork 28.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-47094][SQL] SPJ : Dynamically rebalance number of buckets when they are not equal #45267
Closed
Commits on Mar 13, 2024
-
[SPARK-47094][SQL] SPJ : Dynamically rebalance number of buckets when…
… they are not equal ### What changes were proposed in this pull request? -- Allow SPJ between 'compatible' bucket funtions -- Add a mechanism to define 'reducible' functions, one function whose output can be 'reduced' to another for all inputs. ### Why are the changes needed? -- SPJ currently applies only if the partition transform expressions on both sides are identifical. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Added new tests in KeyGroupedPartitioningSuite ### Was this patch authored or co-authored using generative AI tooling? No
Configuration menu - View commit details
-
Copy full SHA for b2f7cc0 - Browse repository at this point
Copy the full SHA b2f7cc0View commit details -
Configuration menu - View commit details
-
Copy full SHA for cda8b26 - Browse repository at this point
Copy the full SHA cda8b26View commit details -
Configuration menu - View commit details
-
Copy full SHA for eee9198 - Browse repository at this point
Copy the full SHA eee9198View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7bf1610 - Browse repository at this point
Copy the full SHA 7bf1610View commit details -
Configuration menu - View commit details
-
Copy full SHA for 18db83a - Browse repository at this point
Copy the full SHA 18db83aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3fdb0d7 - Browse repository at this point
Copy the full SHA 3fdb0d7View commit details
Commits on Mar 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 23c580f - Browse repository at this point
Copy the full SHA 23c580fView commit details
Commits on Mar 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0c6f494 - Browse repository at this point
Copy the full SHA 0c6f494View commit details -
Configuration menu - View commit details
-
Copy full SHA for d2de9c3 - Browse repository at this point
Copy the full SHA d2de9c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for d3e196c - Browse repository at this point
Copy the full SHA d3e196cView commit details
Commits on Mar 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1fa24a4 - Browse repository at this point
Copy the full SHA 1fa24a4View commit details
Commits on Mar 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8053e58 - Browse repository at this point
Copy the full SHA 8053e58View commit details
Commits on Apr 3, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ad61b0c - Browse repository at this point
Copy the full SHA ad61b0cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0356f9e - Browse repository at this point
Copy the full SHA 0356f9eView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.