Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spark 3.1.0 APIs - Column #887

Merged
merged 4 commits into from
Apr 8, 2021
Merged

Spark 3.1.0 APIs - Column #887

merged 4 commits into from
Apr 8, 2021

Conversation

suhsteve
Copy link
Member

@suhsteve suhsteve commented Apr 7, 2021 •
edited
Loading

PR adds support for the following APIs added in Spark 3.1.0:

Column

def withField(fieldName: String, col: Column): Column
def dropFields(fieldNames: String*): Column

@imback82 imback82 added this to the 2.0.0 milestone Apr 7, 2021
@imback82 imback82 added the enhancement New feature or request label Apr 7, 2021
imback82
imback82 previously approved these changes Apr 7, 2021
View reviewed changes
Copy link
Contributor

@imback82 imback82 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @suhsteve!

@imback82 imback82 merged commit affd7f2 into dotnet:main Apr 8, 2021
@suhsteve suhsteve linked an issue Apr 8, 2021 that may be closed by this pull request
[FEATURE REQUEST]: Support new Spark 3.1 APIs #840
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@imback82 imback82 imback82 left review comments

@Niharikadutta Niharikadutta Awaiting requested review from Niharikadutta

Assignees

@suhsteve suhsteve

Labels
enhancement New feature or request
Projects
None yet
Milestone
2.0.0
Development

Successfully merging this pull request may close these issues.

[FEATURE REQUEST]: Support new Spark 3.1 APIs
2 participants
@suhsteve @imback82