Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-34692][SQL][FOLLOWUP] Add INSET to ReplaceNullWithFalseInPredicate's pattern #32278

Closed
wants to merge 1 commit into from

Conversation

viirya
Copy link
Member

@viirya viirya commented Apr 21, 2021

What changes were proposed in this pull request?

The test added by #31797 has the failure. This is a followup to fix it.

Why are the changes needed?

Due to #32157, the rule ReplaceNullWithFalseInPredicate will check tree pattern before actually doing transformation. As null in INSET is not NULL_LITERAL pattern, we miss it and fail the newly added not inset ... check in replaceNullWithFalse.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Existing unit tests.

@github-actions github-actions bot added the SQL label Apr 21, 2021
@viirya
Copy link
Member Author

viirya commented Apr 21, 2021

cc @cloud-fan @ulysses-you

@SparkQA
Copy link

SparkQA commented Apr 22, 2021

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42282/

@SparkQA
Copy link

SparkQA commented Apr 22, 2021

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42282/

@ulysses-you
Copy link
Contributor

Thanks for catching this !

Seems we need to rebase the code to trigger test with the new added transform framework otherwise it might make the master branch down.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. All test passed except linter job. Linter jobs failure is recovered in master by another PR.

Merged to master. Thank you, @viirya and all.

@viirya
Copy link
Member Author

viirya commented Apr 22, 2021

Thank you @dongjoon-hyun @ulysses-you

@SparkQA
Copy link

SparkQA commented Apr 22, 2021

Test build #137755 has finished for PR 32278 at commit f707ec1.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@viirya viirya deleted the SPARK-34692-followup branch December 27, 2023 18:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants