Skip to content

Commit

Permalink
Fix prefix length
Browse files Browse the repository at this point in the history
  • Loading branch information
Jay Chia committed Mar 29, 2024
1 parent a480d8f commit 43211f8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion daft/filesystem.py
Original file line number Diff line number Diff line change
Expand Up @@ -140,7 +140,7 @@ def _resolve_paths_and_filesystem(

# Sanitize s3a/s3n protocols, which are produced by Hadoop-based systems as a way of denoting which s3
# filesystem client to use. However this doesn't matter for Daft, and PyArrow cannot recognize these protocols.
paths = [f"s3://{p[5:]}" if p.startswith("s3a://") or p.startswith("s3n://") else p for p in paths]
paths = [f"s3://{p[6:]}" if p.startswith("s3a://") or p.startswith("s3n://") else p for p in paths]

# Ensure that protocols for all paths are consistent, i.e. that they would map to the
# same filesystem.
Expand Down

0 comments on commit 43211f8

Please sign in to comment.