Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT] daft-connect support for parquet #3236

Draft
wants to merge 6 commits into
base: andrew/spark-connect
Choose a base branch
from

Conversation

andrewgazelka
Copy link
Member

@andrewgazelka andrewgazelka commented Nov 6, 2024

Closes #3216

@andrewgazelka andrewgazelka marked this pull request as draft November 6, 2024 22:02
@github-actions github-actions bot added the enhancement New feature or request label Nov 6, 2024
@andrewgazelka andrewgazelka changed the base branch from main to andrew/spark-connect November 6, 2024 22:03
Copy link

codspeed-hq bot commented Nov 6, 2024

CodSpeed Performance Report

Merging #3236 will not alter performance

Comparing andrew/daft-connect-parquet (2273b78) with andrew/spark-connect (15ed80d)

Summary

✅ 17 untouched benchmarks

…ency

- Add connect_start method binding to Python interface
- Remove RON dependency and related code
- Register connect modules in Python bindings
- Clean up unused RON serialization config code

This change exposes the connect_start functionality to Python while
simplifying dependencies by removing the unused RON serialization library.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Daft-Connect] Implement Parquet Operations
1 participant