Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Transformer-kinesis: add missing hadoop-aws dependency for s3 parquet files upload #920

Closed
pondzix opened this issue Jun 13, 2022 · 0 comments
Closed

Transformer-kinesis: add missing hadoop-aws dependency for s3 parquet files upload #920

pondzix opened this issue Jun 13, 2022 · 0 comments
Milestone
4.0.2

Comments

@pondzix
Copy link
Contributor

pondzix commented Jun 13, 2022

As reported in #911, there is a problem with uploading created parquet files to s3 AWS storage.

The reason is there is no org.apache.hadoop.fs.FileSystem implementation for s3/s3a on a classpath. Adding hadoop-aws as a runtime dependency should resolve the issue as it provides org.apache.hadoop.fs.s3a.S3AFileSystem class.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
4.0.2
Development

No branches or pull requests
2 participants
@istreeter @pondzix