Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make artifact downloads more robust #41

Merged
merged 3 commits into from
Jul 26, 2024
Merged

Conversation

pstjohn
Copy link
Collaborator

@pstjohn pstjohn commented Jul 25, 2024

Adds md5sum checks and retries to downloads to hopefully prevent CI failures on malformed downloads.

@pstjohn pstjohn requested review from jstjohn and ohadmo July 25, 2024 16:35
@pstjohn
Copy link
Collaborator Author

pstjohn commented Jul 25, 2024

/build-ci

@pstjohn pstjohn force-pushed the pstjohn/v2-main/check_md5_sum branch from cb8fb15 to baf360e Compare July 25, 2024 16:44
@pstjohn
Copy link
Collaborator Author

pstjohn commented Jul 25, 2024

/build-ci

@malcolmgreaves malcolmgreaves self-requested a review July 25, 2024 19:49
Copy link
Collaborator

@malcolmgreaves malcolmgreaves left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with addition of annotated types for new execute_download function. Nice functionality & design 🙌

scripts/download_artifacts.py Outdated Show resolved Hide resolved
"""
md5 = hashlib.md5()
with open(file_path, "rb") as f:
for chunk in iter(lambda: f.read(4096), b""):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Neat trick :) TIL

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

github copilot 😄 , I can't take too much credit

@pstjohn
Copy link
Collaborator Author

pstjohn commented Jul 25, 2024

/build-ci

@pstjohn pstjohn force-pushed the pstjohn/v2-main/check_md5_sum branch from a53e27b to 52b2aa4 Compare July 25, 2024 22:04
@pstjohn
Copy link
Collaborator Author

pstjohn commented Jul 25, 2024

/build-ci

@pstjohn
Copy link
Collaborator Author

pstjohn commented Jul 25, 2024

/build-ci

@pstjohn pstjohn force-pushed the pstjohn/v2-main/check_md5_sum branch from 52b2aa4 to d472143 Compare July 25, 2024 22:27
pstjohn and others added 3 commits July 25, 2024 17:23
Adds md5sum checks and retries to downloads to hopefully prevent CI
failures on malformed downloads.
@pstjohn pstjohn force-pushed the pstjohn/v2-main/check_md5_sum branch from d472143 to 443ae93 Compare July 26, 2024 00:24
@pstjohn
Copy link
Collaborator Author

pstjohn commented Jul 26, 2024

/build-ci

@pstjohn pstjohn enabled auto-merge (squash) July 26, 2024 00:24
@pstjohn pstjohn merged commit 6528e14 into v2-main Jul 26, 2024
1 check passed
@pstjohn pstjohn deleted the pstjohn/v2-main/check_md5_sum branch July 30, 2024 20:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants