Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for AVRO format (trying to use arrow_avro) #5562

Closed
dsalv opened this issue Mar 28, 2024 · 3 comments
Closed

Support for AVRO format (trying to use arrow_avro) #5562

dsalv opened this issue Mar 28, 2024 · 3 comments
Labels
question Further information is requested

Comments

@dsalv
Copy link

dsalv commented Mar 28, 2024 •
edited
Loading

Which part is this question about

arrow_avro

Describe your question

  • I see that there is arrow_avro module but it doesn't have documentation. Is there any example of how we can use it? Most of the things in that module are private and cannot be used.

  • Is arrow_avro still in development? If so, is there any expected timeline for adding the support?

  • What's the recommended way to handle AVRO format with arrow?

Thank you in advance

Additional context
@dsalv dsalv added the question Further information is requested label Mar 28, 2024
@tustvold
Copy link
Contributor

See #4886

Development has somewhat stalled but I hope to finish it up over the next few months

@dsalv
Copy link
Author

dsalv commented Mar 28, 2024 •
edited
Loading

See #4886

Development has somewhat stalled but I hope to finish it up over the next few months

Thanks for your quick reply. Is it possible to somehow use arrow_avro as is? I wanted to avoid reading AVRO file using avro-rs and then converting data to arrow format (which will be similar to what you're developing)

@tustvold
Copy link
Contributor

Is it possible to somehow use arrow_avro as is

The support isn't yet at a state where it is usable

@ianmcook ianmcook mentioned this issue Apr 26, 2024
Merged
ianmcook added a commit to apache/arrow that referenced this issue Apr 26, 2024
@ianmcook
GH-41386: [Docs] Document Arrow Go Avro read support (#41393)
0f56339 
Updates the Implementation Status docs page to reflect that the Go
implementation can read Avro files.

For the Rust implementation, I inferred from [this
PR](apache/arrow-rs#4886) and [this
comment](apache/arrow-rs#5562 (comment))
that we should hold off on indicating that the Rust implementation can
read Avro files.

* GitHub Issue: #41386
@ianmcook ianmcook mentioned this issue Apr 26, 2024
Closed
tolleybot pushed a commit to tmct/arrow that referenced this issue May 2, 2024
@ianmcook @tolleybot
apacheGH-41386: [Docs] Document Arrow Go Avro read support (apache#41393
ec7c3fa 
)

Updates the Implementation Status docs page to reflect that the Go
implementation can read Avro files.

For the Rust implementation, I inferred from [this
PR](apache/arrow-rs#4886) and [this
comment](apache/arrow-rs#5562 (comment))
that we should hold off on indicating that the Rust implementation can
read Avro files.

* GitHub Issue: apache#41386
tolleybot pushed a commit to tmct/arrow that referenced this issue May 4, 2024
@ianmcook @tolleybot
apacheGH-41386: [Docs] Document Arrow Go Avro read support (apache#41393
dc54450 
)

Updates the Implementation Status docs page to reflect that the Go
implementation can read Avro files.

For the Rust implementation, I inferred from [this
PR](apache/arrow-rs#4886) and [this
comment](apache/arrow-rs#5562 (comment))
that we should hold off on indicating that the Rust implementation can
read Avro files.

* GitHub Issue: apache#41386
rok pushed a commit to tmct/arrow that referenced this issue May 8, 2024
@ianmcook @rok
apacheGH-41386: [Docs] Document Arrow Go Avro read support (apache#41393
f52427d 
)

Updates the Implementation Status docs page to reflect that the Go
implementation can read Avro files.

For the Rust implementation, I inferred from [this
PR](apache/arrow-rs#4886) and [this
comment](apache/arrow-rs#5562 (comment))
that we should hold off on indicating that the Rust implementation can
read Avro files.

* GitHub Issue: apache#41386
rok pushed a commit to tmct/arrow that referenced this issue May 8, 2024
@ianmcook @rok
apacheGH-41386: [Docs] Document Arrow Go Avro read support (apache#41393
083f5f5 
)

Updates the Implementation Status docs page to reflect that the Go
implementation can read Avro files.

For the Rust implementation, I inferred from [this
PR](apache/arrow-rs#4886) and [this
comment](apache/arrow-rs#5562 (comment))
that we should hold off on indicating that the Rust implementation can
read Avro files.

* GitHub Issue: apache#41386
vibhatha pushed a commit to vibhatha/arrow that referenced this issue May 25, 2024
@ianmcook @vibhatha
apacheGH-41386: [Docs] Document Arrow Go Avro read support (apache#41393
07cac5b 
)

Updates the Implementation Status docs page to reflect that the Go
implementation can read Avro files.

For the Rust implementation, I inferred from [this
PR](apache/arrow-rs#4886) and [this
comment](apache/arrow-rs#5562 (comment))
that we should hold off on indicating that the Rust implementation can
read Avro files.

* GitHub Issue: apache#41386
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tustvold @dsalv