Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Flyte pod webhook uses certs with a 1 year expiration #2871

Closed
2 tasks done
hamersaw opened this issue Sep 12, 2022 · 3 comments · Fixed by flyteorg/flytepropeller#535
Closed
2 tasks done

[BUG] Flyte pod webhook uses certs with a 1 year expiration #2871

hamersaw opened this issue Sep 12, 2022 · 3 comments · Fixed by flyteorg/flytepropeller#535
Assignees
Labels
bug Something isn't working propeller Issues related to flyte propeller
Milestone

Comments

@hamersaw
Copy link
Contributor

Describe the bug

Currently the flyte pod webhook, which is responsible for injecting secrets, creates a self signed cert with a 1 year expiration. This is problematic for long-running Flyte deployments because once the certificate expires all calls to the webhook will fail with "x509: certificate has expired or is not yet valid". As the failurePolicy on the mutating webhook configuration is set to Ignore by default this means that transparently secrets will stop getting injected - resulting in task failures.

Expected behavior

Secret injection should support a longer than 1 year lifetime.

Additional context to reproduce

Just have a really long running pod webhook deployment .. like really long ... and start to notice that secret injection doesn't work anymore.

Screenshots

No response

Are you sure this issue hasn't been raised already?

  • Yes

Have you read the Code of Conduct?

  • Yes
@hamersaw hamersaw added bug Something isn't working untriaged This issues has not yet been looked at by the Maintainers labels Sep 12, 2022
@hamersaw hamersaw added this to the 1.3.0 milestone Sep 12, 2022
@hamersaw hamersaw added propeller Issues related to flyte propeller and removed untriaged This issues has not yet been looked at by the Maintainers labels Sep 12, 2022
@eapolinario eapolinario self-assigned this Oct 5, 2022
@eapolinario
Copy link
Contributor

@hamersaw , what would be the downside of having the expiration date set to some incredibly far out date, say, 100 years in the future?

@eapolinario eapolinario modified the milestones: 1.3.0, 1.4.0 Jan 13, 2023
@hamersaw
Copy link
Contributor Author

@eapolinario the only real downside is the security implications of a long running cert. If it's a self signed cert we could probably just generate another one if it is expired?

@EngHabu it looks like you may have done the initial implementation. Was there any particular reason to choose 1 year expiration?

@cosmicBboy cosmicBboy removed this from the 1.4.0 milestone Jan 18, 2023
@eapolinario
Copy link
Contributor

We sync'd offline and decided that we're going to extend the self-signed certificate expiration date to 99 years.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working propeller Issues related to flyte propeller
Projects
None yet
3 participants