Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Releas Candidate 5.10.1 #415

Merged
merged 33 commits into from
Jun 27, 2024
Merged

Releas Candidate 5.10.1 #415

merged 33 commits into from
Jun 27, 2024

Conversation

joneubank
Copy link
Contributor

@joneubank joneubank commented Jun 27, 2024

Description

This release includes a new feature to allow Score servers to handle downloading files from an S3 backend when the .meta file describing a file upload is not found. In normal operation, this feature will have no impact on Score servers. If for any reason the Score-generated .meta files cannot be found, then the download service will calculate the available parts and file description from the S3 object metadata. In particular, the object MD5 can now be read either from the built-in S3 API's ContentMD5 property, or in a custom user Metadata field. This provides more flexibility for Score to serve files that were not originally uploaded to the S3 server through the Score upload CLI. This also makes it download from S3 objects that were transferred from an Azure instance to S3.

One additional change is included that removes Score's dependency on ICGC specific Java packages. The related code has been added to the Score Core package.

Included Changes

MitchellShiell and others added 30 commits September 22, 2023 13:43
* fix conjars repo to exclude

* score test disable conjars repo

* conjars repository id

* mirror conjars

* add comment

* remove maven profiler extension
using fmt-maven-plugin to format code
Fix related to eliminating the dcc Dependencies and unsed tests from the code
S3 Service using API instead of .meta file
Refactor S3 Bucket Name Retrieval Method
…d Bucket Methods (#409)

* Refactor S3 Bucket Name Retrieval Method

* Improve Handling of Empty and Whitespace Parameters in Key, MetaKey, and Bucket Methods
Azher2Ali and others added 3 commits June 24, 2024 17:29
…ilable (#413)

* Refactor S3 Bucket Name Retrieval Method

* Object Retrieval: Support for Multipart Uploads

* Used getContentLength() from the ObjectMetaData to Calculate the part

* Update Part.java

Reverting changes related to Part.java

* Handle case where external=false and length < 0

---------

Co-authored-by: AzherAliMohammed <[email protected]>
Co-authored-by: Jon Eubank <[email protected]>
* Retrieve MD5 from object metadata

* Decode Base64 formatted contentMD5 value
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Contributor

@leoraba leoraba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@joneubank joneubank merged commit 0cfd42f into master Jun 27, 2024
2 checks passed
@joneubank joneubank deleted the rc/5.10.1 branch June 27, 2024 16:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants