You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Now datafusion doesn't process predicate pushdown correctly when there is outer join. I have discussed much in #1339 with @alamb. I think we ended up with a consensus.
Notes that filtering conditions fall into two categories: join condition and where condition, I'll explain them separately in the following:
join condition: if the filter condition contains the non-nullable-side table, it can't be pushed down.
xudong963
changed the title
Predicate pushdown requires special process for outer Join.
datafusion doesn't process predicate pushdown correctly when there is outer join
Jan 16, 2022
Describe the bug
Now datafusion doesn't process predicate pushdown correctly when there is
outer join
. I have discussed much in #1339 with @alamb. I think we ended up with a consensus.Notes that filtering conditions fall into two categories:
join condition
andwhere condition
, I'll explain them separately in the following:outer join
toinner join
to improve performance #1585.Additional context
related issues and pr: #1321 , #1585, #1339
The text was updated successfully, but these errors were encountered: