-
Notifications
You must be signed in to change notification settings - Fork 115
Conversation
src/main/scala/com/microsoft/hyperspace/index/IndexLogEntry.scala
Outdated
Show resolved
Hide resolved
Do you have any plan for code management of both spark 2.4.6 and 3.0.0? |
The current plan is to have 3.0 support in |
That should be fine for developers :) |
.getSnapshot | ||
.filesForScan(projection = Nil, location.partitionFilters) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@sezruby in Delta 8.0, there were some changes in the API. Could you confirm if these changes are fine?
@andrei-ionescu In Spark 3.0,
|
closed by #421 |
What changes were proposed in this pull request?
This PR proposes to support Spark 3.0. I will share more about branching strategies, etc. as a separate PR.
Why are the changes needed?
To support Spark 3.0.
Does this PR introduce any user-facing change?
Yes. The user needs to consume this library along with Spark 3.0. This is not compatible with Scala 2.11 any longer.
How was this patch tested?
Updated existing tests.