Skip to content
This repository has been archived by the owner on Oct 9, 2023. It is now read-only.

[Storage] Allow setting http headers for default http client #61

Merged
merged 7 commits into from
Apr 15, 2020

Conversation

EngHabu
Copy link
Contributor

@EngHabu EngHabu commented Mar 31, 2020

TL;DR

Exposes a config in storage config section to allow setting http headers to the default http client. This is because some of the underlying storage systems (e.g. s3 stow) doesn't allow setting some settings (e.g. ACL) and the only way to support that is through setting HTTP HEADERS that AWS S3 respects.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Tracking Issue

flyteorg/flyte#261

@EngHabu EngHabu changed the title HACK: force aws bucket owner full control on all requests [Storage] Allow setting http headers for default http client Apr 13, 2020
@EngHabu EngHabu requested a review from akhurana001 April 13, 2020 22:35
storage/config.go Outdated Show resolved Hide resolved
Limits LimitsConfig `json:"limits" pflag:",Sets limits for stores."`
Cache CachingConfig `json:"cache"`
Limits LimitsConfig `json:"limits" pflag:",Sets limits for stores."`
DefaultHTTPClient *HTTPClientConfig `json:"defaultHttpClient" pflag:",Sets the default http client config."`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this makes it sound like a client, not a config for a client.

Copy link
Contributor Author

@EngHabu EngHabu Apr 14, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar to Cache? the entire thing is a config but then I'm terrible with names... suggestions?

@wild-endeavor
Copy link
Contributor

up to you on the name, let me know when you want a +1

wild-endeavor
wild-endeavor previously approved these changes Apr 14, 2020
wild-endeavor
wild-endeavor previously approved these changes Apr 14, 2020
@EngHabu EngHabu merged commit c30fd2b into master Apr 15, 2020
eapolinario pushed a commit that referenced this pull request Sep 6, 2023
Exposes a config in storage config section to allow setting http headers to the default http client. This is because some of the underlying storage systems (e.g. s3 stow) doesn't allow setting some settings (e.g. ACL) and the only way to support that is through setting HTTP HEADERS that AWS S3 respects.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants