Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to complete multipart upload in Google-cloud-storage #647

Open
aravinds502 opened this issue Jun 10, 2024 · 1 comment
Open

Unable to complete multipart upload in Google-cloud-storage #647

aravinds502 opened this issue Jun 10, 2024 · 1 comment

Comments

@aravinds502
Copy link

I see the following error while issuing the Complete multipart request.
MultiParts have been uploaded and "etags" were generated for each of it

private S3Client client; // build s3 client with s3proxy credentials

 CompleteMultipartUploadRequest completeMultipartUploadRequest = CompleteMultipartUploadRequest.builder()
                    .bucket(bucket)
                    .key(storagePath)
                    .uploadId(uploadId)
                    .multipartUpload(CompletedMultipartUpload.builder().parts(completedParts).build())
                    .build();

 CompleteMultipartUploadResponse response = client.completeMultipartUpload(completeMultipartUploadRequest);
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 o.j.h.i.JavaUrlHttpCommandExecutorService:56 |::] Receiving response 2081972118: HTTP/1.1 400 Bad Request
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << HTTP/1.1 400 Bad Request
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Server: UploadServer
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << X-GUploader-UploadID: ABPtcPolFLooXcz5Nu-q32YcrZat3vjqx8Q58d0fnqYJDhGJMNZfTw4GztL9hLfikk_wmN9LM-fjFfjGWg
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Vary: X-Origin
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Vary: Origin
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Pragma: no-cache
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Date: Mon, 10 Jun 2024 13:03:30 GMT
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Cache-Control: no-cache, no-store, max-age=0, must-revalidate
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Content-Type: application/json; charset=UTF-8
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Content-Length: 492
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.headers:56 |::] << Expires: Mon Jan 01 00:00:00 UTC 1990
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "{[\n]"
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "  "error": {[\n]"
[s3proxy] D 06-10 13:03:31.000 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "    "code": 400,[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "    "message": "Cannot get legacy ACL for an object when uniform bucket-level access is enabled. Read more at https://cloud.google.com/storage/docs/uniform-bucket-level-access",[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "    "errors": [[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "      {[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "        "message": "Cannot get legacy ACL for an object when uniform bucket-level access is enabled. Read more at https://cloud.google.com/storage/docs/uniform-bucket-level-access",[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "        "domain": "global",[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "        "reason": "invalid"[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "      }[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "    ][\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "  }[\n]"
[s3proxy] D 06-10 13:03:31.001 S3Proxy-Jetty-13 jclouds.wire:56 |::] << "}[\n]"
 
@aravinds502
Copy link
Author

Why does the GCS multipart upload, call for /acl/allusers ?

15:58:33.254 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- >> GET https://www.googleapis.com/storage/v1/b/internal-gcp-1-data-catalog-bucket/o/ea243965-cf92-48e7-82e3-8370097ed5f3/acl/allUsers HTTP/1.1
15:58:33.254 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- >> Accept: application/json
15:58:33.254 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- >> Authorization: Bearer ya29.c.c0AY_VpZhkLlEPEA8SAsX1Y_yp1XbwV4_1bD4UzqkvO6Xu6EGkQWtE-fdgug2970KNLBkuUn_qFfdhxcsIj0zcDOkPOmaJqMV9XhJMIEQIiYLryaLkgVphT1JQJsW_x_Yz3uS94Bk7W-J2kS4UYRiGUpAAn_Z0f7GyW6exqC5sR_iZ90UAVWfw7SHdrXqpt5v1K2yyVToRxaJQqmo8ky9HkFpjiQIINyN8658VRguytViCDioVrmlRXvLvckQwgZ1rXnwuqyRd2fNJ_C5dsCecgvedgjo1tbyKtCNJ7nw-1-_IbvoQ4Hj2d5VtdIrvMZx9oQCWMQy93lAypsELMNBV0YWZjNsxVogwuwgoOZ2ABVpvXTC3EcqLFwcG384Ax1y8dzq3IcyOX_hQv7i4JFm7Y7U73zg7VjJU3X9vsRYk3FpmdZdZkbxgcwR3V36j72cI7tddv056-qzrs51e_wsfMaYzzmIS7sd_owlQ6t5jXZbWcQFUqSvSOBsp33rXwSnBf_uOJej9gkYdhJueSIvBn-dyB1vhoS_g66Q1j7_hrdp_83z4_p32r2Bxk88p4gBc4BWwx5l4hbawepvip3j7s4e1Mcmf_mo_gjWW-Mbf3snW_OO07hJZororpXdY-z4Ft7Ssdr6ddzgYWamre6jZUYQ477JMSdtVuSOop9vsiztiiBz0IdYhrn0zmcjki43vmU9299lXsQe_yb0VoYfmsfZ6BjMpxpoRkFQBuRlpajUOXFzOXcagQyY9yJhwz4oXIhcqBk5ed0s0isO3V8RovdIp0zI6_lryckx3U1poIbjM3oSbWI7OYdi0k_3ej5v-ZFSg5fxhf-lkIy10bjZyQFQFhxIfkn9zvukVZrOc1s5wltsSkwt_5e9-1uqYwFifaxzUwz8Il-40mmvIfydsWQlYop_dhgz-k3bQmBJd4os2p_XaVVsnb_eYpRbQUjURS4fwOxRgSpISz4aJrg47VrYtpWSq9e0-wWk_00wznYeiXFYzn1ig9BB
15:58:34.371 [S3Proxy-Jetty-29] DEBUG org.jclouds.http.internal.JavaUrlHttpCommandExecutorService -- Receiving response -964707704: HTTP/1.1 400 Bad Request
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << HTTP/1.1 400 Bad Request
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Server: UploadServer
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << X-GUploader-UploadID: ACJd0NrE28DF1iaibkgrEgS9eeD2mWgjSjuhbZMA4vr_nrFPMvRW8qiHFwIJc6FZNXjxGIeLh-8
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Vary: X-Origin
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Vary: Origin
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Pragma: no-cache
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Date: Mon, 24 Jun 2024 10:28:14 GMT
15:58:34.371 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Cache-Control: no-cache, no-store, max-age=0, must-revalidate
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Content-Type: application/json; charset=UTF-8
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Content-Length: 492
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.headers -- << Expires: Mon Jan 01 05:30:00 IST 1990
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << "{[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " "error": {[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " "code": 400,[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " "message": "Cannot get legacy ACL for an object when uniform bucket-level access is enabled. Read more at https://cloud.google.com/storage/docs/uniform-bucket-level-access",[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " "errors": [[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " {[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " "message": "Cannot get legacy ACL for an object when uniform bucket-level access is enabled. Read more at https://cloud.google.com/storage/docs/uniform-bucket-level-access",[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " "domain": "global",[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " "reason": "invalid"[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " }[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " ][\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << " }[\n]"
15:58:34.372 [S3Proxy-Jetty-29] DEBUG jclouds.wire -- << "}[\n]"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants