Skip to content

Commit

Permalink
Update docs and fix minor mistakes.
Browse files Browse the repository at this point in the history
  • Loading branch information
@yuqi1129
yuqi1129 committed Nov 14, 2024
1 parent e59346c commit a9c64f1
Show file tree
Hide file tree
Showing 4 changed files with 12 additions and 13 deletions.
2 changes: 1 addition & 1 deletion bundles/azure-bundle/src/main/java/org/apache/gravitino/abs/fs/AzureFileSystemProvider.java
View file
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ public class AzureFileSystemProvider implements FileSystemProvider {

@VisibleForTesting public static final String ABS_PROVIDER_SCHEME = "abfss";

@VisibleForTesting public static final String ABS_PROVIDER_NAME = "abfs";
@VisibleForTesting public static final String ABS_PROVIDER_NAME = "abs";

private static final String ABFS_IMPL = "org.apache.hadoop.fs.azurebfs.SecureAzureBlobFileSystem";

Expand Down
12 changes: 6 additions & 6 deletions docs/hadoop-catalog.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -79,12 +79,12 @@ In the meantime, you need to place the corresponding bundle jar [`gravitino-aliy

#### Azure Blob Storage fileset

| Configuration item | Description | Default value | Required | Since version |
|-------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------|-------------------------------------------|------------------|
| `filesystem-providers` | The file system providers to add. Set it to `abfs` if it's a Azure block storage fileset, or a comma separated string that contains `abfs` like `oss,abfs,s3` to support multiple kinds of fileset including `abfs`. | (none) | Yes | 0.8.0-incubating |
| `default-filesystem-provider` | The name default filesystem providers of this Hadoop catalog if users do not specify the scheme in the URI. Default value is `builtin-local`, for Azure block store, if we set this value, we can omit the prefix 'abfss://' in the location. | `builtin-local` | No | 0.8.0-incubating |
| `abs-account-name` | The account name of Azure blob storage. | (none) | Yes if it's a Azure blob storage fileset. | 0.8.0-incubating |
| `abs-account-key` | The account key of Azure blob storage. | (none) | Yes if it's a Azure blob storage fileset. | 0.8.0-incubating |
| Configuration item | Description | Default value | Required | Since version |
|-------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------|-------------------------------------------|------------------|
| `filesystem-providers` | The file system providers to add. Set it to `abs` if it's a Azure blob storage fileset, or a comma separated string that contains `abfs` like `oss,abs,s3` to support multiple kinds of fileset including `abs`. | (none) | Yes | 0.8.0-incubating |
| `default-filesystem-provider` | The name default filesystem providers of this Hadoop catalog if users do not specify the scheme in the URI. Default value is `builtin-local`, for Azure blob storage, if we set this value, we can omit the prefix 'abfss://' in the location. | `builtin-local` | No | 0.8.0-incubating |
| `abs-account-name` | The account name of Azure blob storage. | (none) | Yes if it's a Azure blob storage fileset. | 0.8.0-incubating |
| `abs-account-key` | The account key of Azure blob storage. | (none) | Yes if it's a Azure blob storage fileset. | 0.8.0-incubating |

Similar to the above, you need to place the corresponding bundle jar [`gravitino-azure-bundle-${version}.jar`](https://repo1.maven.org/maven2/org/apache/gravitino/azure-bundle/) in the directory `${GRAVITINO_HOME}/catalogs/hadoop/libs`.

Expand Down
10 changes: 5 additions & 5 deletions docs/how-to-use-gvfs.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -104,11 +104,11 @@ In the meantime, you need to place the corresponding bundle jar [`gravitino-aliy

#### Azure blob storage fileset

| Configuration item | Description | Default value | Required | Since version |
|--------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------|-------------------------------------------|------------------|
| `fs.gvfs.filesystem.providers` | The file system providers to add. Set it to `abfs` if it's a Azure block storage fileset, or a comma separated string that contains `abfs` like `oss,abfs,s3` to support multiple kinds of fileset including `abfs`. | (none) | Yes | 0.8.0-incubating |
| `abs-account-name` | The account name of Azure blob storage. | (none) | Yes if it's a Azure blob storage fileset. | 0.8.0-incubating |
| `abs-account-key` | The account key of Azure blob storage. | (none) | Yes if it's a Azure blob storage fileset. | 0.8.0-incubating |
| Configuration item | Description | Default value | Required | Since version |
|--------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------|-------------------------------------------|------------------|
| `fs.gvfs.filesystem.providers` | The file system providers to add. Set it to `abs` if it's a Azure blob storage fileset, or a comma separated string that contains `abs` like `oss,abs,s3` to support multiple kinds of fileset including `abs`. | (none) | Yes | 0.8.0-incubating |
| `abs-account-name` | The account name of Azure blob storage. | (none) | Yes if it's a Azure blob storage fileset. | 0.8.0-incubating |
| `abs-account-key` | The account key of Azure blob storage. | (none) | Yes if it's a Azure blob storage fileset. | 0.8.0-incubating |

Similar to the above, you need to place the corresponding bundle jar [`gravitino-azure-bundle-${version}.jar`](https://repo1.maven.org/maven2/org/apache/gravitino/azure-bundle/) in the Hadoop environment(typically located in `${HADOOP_HOME}/share/hadoop/common/lib/`).

Expand Down
1 change: 0 additions & 1 deletion settings.gradle.kts
View file
Original file line number Diff line number Diff line change
Expand Up @@ -75,4 +75,3 @@ include(":bundles:aws-bundle")
include(":bundles:gcp-bundle")
include(":bundles:aliyun-bundle")
include("bundles:azure-bundle")
findProject(":bundles:azure-bundle")?.name = "azure-bundle"

0 comments on commit a9c64f1

Please sign in to comment.