Skip to content

Commit

Permalink
Use native S3 filesystem for Databricks tests
Browse files Browse the repository at this point in the history
  • Loading branch information
findepi committed Mar 18, 2024
1 parent d286369 commit 9ae76cc
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ connector.name=delta_lake
hive.metastore=glue
hive.metastore.glue.region=${ENV:AWS_REGION}
# We need to give access to bucket owner (the AWS account integrated with Databricks), otherwise files won't be readable from Databricks
fs.hadoop.enabled=true
hive.s3.upload-acl-type=BUCKET_OWNER_FULL_CONTROL
fs.hadoop.enabled=false
fs.native-s3.enabled=true
delta.enable-non-concurrent-writes=true
delta.hive-catalog-name=hive

0 comments on commit 9ae76cc

Please sign in to comment.