Skip to content
This repository has been archived by the owner on Oct 23, 2023. It is now read-only.

Add prefix to data upload #416

Merged
merged 3 commits into from
Jun 20, 2023
Merged

Add prefix to data upload #416

merged 3 commits into from
Jun 20, 2023

Conversation

wild-endeavor
Copy link
Contributor

@wild-endeavor wild-endeavor commented Jun 14, 2023

TL;DR

This adds a field that will replace the content_md5-based string in Admin in the data upload link create request.

See flyteorg/flyteadmin#577 for use

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

How did you fix the bug, make the feature etc. Link to any design docs etc

Tracking Issue

Signed-off-by: Yee Hing Tong <[email protected]>
@codecov
Copy link

codecov bot commented Jun 14, 2023

Codecov Report

Merging #416 (af71cd6) into master (e506206) will increase coverage by 2.55%.
The diff coverage is n/a.

❗ Current head af71cd6 differs from pull request most recent head 233fbc6. Consider uploading reports for the commit 233fbc6 to get more accurate results

@@            Coverage Diff             @@
##           master     #416      +/-   ##
==========================================
+ Coverage   75.92%   78.48%   +2.55%     
==========================================
  Files          18       18              
  Lines        1458     1250     -208     
==========================================
- Hits         1107      981     -126     
+ Misses        294      212      -82     
  Partials       57       57              
Flag Coverage Δ
unittests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

see 18 files with indirect coverage changes

Signed-off-by: Yee Hing Tong <[email protected]>
Signed-off-by: Yee Hing Tong <[email protected]>
@wild-endeavor wild-endeavor marked this pull request as ready for review June 16, 2023 21:14
Comment on lines +26 to +29
// The implementation in data proxy service will create the s3 location with some server side configured prefixes,
// and then:
// - project/domain/(a deterministic str representation of the content_md5)/filename (if present); OR
// - project/domain/filename_root (if present)/filename (if present).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❤️

@wild-endeavor wild-endeavor merged commit 2834723 into master Jun 20, 2023
@wild-endeavor wild-endeavor deleted the optional-prefix-upload branch June 20, 2023 17:43
eapolinario pushed a commit that referenced this pull request Sep 8, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants