Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Writing to ozone failed without setting alluxio.underfs.version #18221

Open
Haoning-Sun opened this issue Sep 27, 2023 · 1 comment
Open

Writing to ozone failed without setting alluxio.underfs.version #18221

Haoning-Sun opened this issue Sep 27, 2023 · 1 comment
Labels
type-bug This issue is about a bug

Comments

@Haoning-Sun
Copy link
Contributor

Alluxio Version:
2.x

Describe the bug
Writing to ozone failed without setting alluxio.underfs.version.

WARN  ExtensionFactoryRegistry - No factory implementation supports the path o3fs://xxx.xxx/
WARN  UnderFileSystemFactoryRegistry - Versions [xxx] are supported for path o3fs://xxx.xxx/ but you have configured version: xxx
java.lang.IllegalArgumentException: No Under File System Factory found for: o3fs://xxx.xxx/
        at alluxio.underfs.UnderFileSystem$Factory.create(UnderFileSystem.java:95)
        at alluxio.underfs.AbstractUfsManager.getOrAdd(AbstractUfsManager.java:132)
        at alluxio.underfs.AbstractUfsManager.lambda$addMount$0(AbstractUfsManager.java:183)
        at alluxio.underfs.UfsManager$UfsClient.acquireUfsResource(UfsManager.java:61)
        at alluxio.worker.grpc.UfsFileWriteHandler.createUfsFile(UfsFileWriteHandler.java:155)
        at alluxio.worker.grpc.UfsFileWriteHandler.writeBuf(UfsFileWriteHandler.java:139)
        at alluxio.worker.grpc.UfsFileWriteHandler.writeBuf(UfsFileWriteHandler.java:49)
        at alluxio.worker.grpc.AbstractWriteHandler.writeData(AbstractWriteHandler.java:281)
        at alluxio.worker.grpc.AbstractWriteHandler.lambda$writeDataMessage$1(AbstractWriteHandler.java:179)
        at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
        at alluxio.worker.grpc.GrpcExecutors$ImpersonateThreadPoolExecutor.lambda$execute$0(GrpcExecutors.java:159)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

To Reproduce

  1. Start a cluster without setting alluxio.underfs.version;
  2. Add a mount point for an ozone bucket without setting alluxio.underfs.version;
  3. Upload a file to the ozone bucket.

Expected behavior
Can write files.

Are you planning to fix it
Yes.

@jja725
Copy link
Contributor

jja725 commented Oct 2, 2023

Thanks for raising the issue and fix it! I would take a look

alluxio-bot pushed a commit that referenced this issue Oct 13, 2023
### What changes are proposed in this pull request?

Check cluster ufs version in getClusterConf.

### Why are the changes needed?

Fix #18221.

			pr-link: #18222
			change-id: cid-2c67758e30cac31a84f41d47b50c0ed958c88ffb
maobaolong pushed a commit to maobaolong/alluxio that referenced this issue Jan 3, 2024
### What changes are proposed in this pull request?

Check cluster ufs version in getClusterConf.

### Why are the changes needed?

Fix Alluxio#18221.

			pr-link: Alluxio#18222
			change-id: cid-2c67758e30cac31a84f41d47b50c0ed958c88ffb
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type-bug This issue is about a bug
Projects
None yet
Development

No branches or pull requests

2 participants