feat: introduce opendal AsyncWriter for parquet integrations
#4958
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
BTW, How can I generate a |
3 tasks
https://opendal.apache.org/community/release/#generate-dependencies-list |
Thank you for the PR. This task will be handled by the Release Manager during the release process, so it's not something most contributors need to worry about. However, thanks to @PsiACE's reference, we have a document available at https://opendal.apache.org/community/release/#generate-dependencies-list if you are interested. |
Xuanwo
reviewed
Aug 5, 2024
Xuanwo
reviewed
Aug 5, 2024
WenyXu
force-pushed
the
feat/parquet-async-writer
branch
from
6c3d08c
to
aa46108
Compare
Xuanwo
reviewed
Aug 5, 2024
Xuanwo
changed the title
OpendalAsyncWriter for parquet integrations AsyncWriter for parquet integrations
Xuanwo
reviewed
Aug 5, 2024
ho-229
pushed a commit
to ho-229/incubator-opendal
that referenced
this pull request
Aug 6, 2024
…e#4958) * chore: init parquet crate * feat: implement the `OpendalAsyncWriter` * chore: apply suggestions from CR * chore: remove arrow dep from default * chore(ci): add ci for opendal_parquet * test: add test for async writer * chore: remove arrow dep * chore(ci): add doc test * Update .github/workflows/ci_integration_parquet.yml * chore(ci): run cargo test --------- Co-authored-by: Xuanwo <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Which issue does this PR close?
part of #4868
Rationale for this change
Add parquet arrow async write support
What changes are included in this PR?
parquet_opendal(integration/parquet) crateOpendalAsyncWriterAre there any user-facing changes?
No