[Datasets] Add AWS CLI info into S3 credential error messagee (ray-pr…

…oject#26789) As followup of ray-project#26669 (comment), we want to add AWS CLI command information into S# credential error message, so users have a better idea to further debug the read issue. Signed-off-by: Rohan138 <[email protected]>
Rohan138 · Jul 28, 2022 · 2b77bfd · 2b77bfd
1 parent f10675c
commit 2b77bfd
Showing 1 changed file with 4 additions and 1 deletion.
diff --git a/python/ray/data/datasource/file_meta_provider.py b/python/ray/data/datasource/file_meta_provider.py
@@ -346,7 +346,10 @@ def _handle_read_os_error(error: OSError, paths: Union[str, List[str]]) -> str:
             (
                 f"Failing to read AWS S3 file(s): {paths}. "
                 "Please check that file exists and has properly configured access. "
-                "See https://docs.ray.io/en/latest/data/creating-datasets.html#reading-from-remote-storage "  # noqa
+                "You can also run AWS CLI command to get more detailed error message "
+                "(e.g., aws s3 ls <file-name>). "
+                "See https://awscli.amazonaws.com/v2/documentation/api/latest/reference/s3/index.html "  # noqa
+                "and https://docs.ray.io/en/latest/data/creating-datasets.html#reading-from-remote-storage "  # noqa
                 "for more information."
             )
         )