Skip to content

Add support for additional HTTP checksum algorithms and user-specified MD5s#10099

Merged
ashovlin merged 2 commits intoaws:v2from
ashovlin:additional-http-checksums
Feb 27, 2026
Merged

Add support for additional HTTP checksum algorithms and user-specified MD5s#10099
ashovlin merged 2 commits intoaws:v2from
ashovlin:additional-http-checksums

Conversation

@ashovlin
Copy link
Copy Markdown
Member

@ashovlin ashovlin commented Feb 20, 2026

Issue #, if available: N/A

Description of changes: Porting boto/botocore#3637 and boto/botocore#3639 from boto/CLIv1. This adds support for SHA512, XXHASH64, XXHASH3, XXHASH128 as well passing MD5 to supported services if calculated in advance.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@ashovlin
Copy link
Copy Markdown
Member Author

Added boto/botocore#3639 in 1f313e0


_SUPPORTED_CHECKSUM_ALGORITHMS = list(_CHECKSUM_CLS.keys())
_ALGORITHMS_PRIORITY_LIST = ['crc64nvme', 'crc32c', 'crc32', 'sha1', 'sha256']
_ALGORITHMS_PRIORITY_LIST = [
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The algorithm priority list differs from what I'd expect based on the internal spec, can you confirm if this ordering was intentionally updated or do we have new performance data?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Clarified offline with @SamRemis

@ashovlin ashovlin merged commit 203364b into aws:v2 Feb 27, 2026
60 of 61 checks passed
@ashovlin ashovlin deleted the additional-http-checksums branch February 27, 2026 20:51
aemous pushed a commit to aemous/aws-cli that referenced this pull request Mar 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants