Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
For S3 downloads, when handling downloads in cases where the
.meta
file is not found, we need to retrieve the MD5 sum from the Object metadata. Our current implementation of this is reading the value of the eTag, but this is not guaranteed to contain an MD5 hash (and for multipart uploads is known to never contain the MD5 hash).This change introduces a function to get the MD5 hash from the metadata. The function has two cases to check for where the MD5 hash might be.
md5chksum
which corresponds to the property name where the md5 is stored in Azure systems. This will match for cases where data is moved from Azure Blob storage into an S3 Object Storage system.