Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear finalizer on abort for arrays #5221

Closed
wants to merge 1 commit into from

Conversation

RRap0so
Copy link
Contributor

@RRap0so RRap0so commented Apr 11, 2024

Tracking issue

Closes #5222

Why are the changes needed?

This adds the ability for propeller to remove finalizer when the Phase of the plugin execution is aborted. This somewhat mimics what was done in the Happy path phase with small differences.

Note: We've tested this PR in our test cluster and noticed some slowness in cleaning the pods but they eventually are cleaned up (about 500 pods) not sure if expected or not and can test this further.

What changes were proposed in this pull request?

Before the deletion of pod we remove the finalizer of the aborted MapTask if set

How was this patch tested?

In our test cluster, no unit tests added since there's no unit tests for subtask.go

Setup process

Screenshots

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Related PRs

Docs link

Signed-off-by: Rafael Raposo <[email protected]>
@dosubot dosubot bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Apr 11, 2024
@RRap0so RRap0so marked this pull request as draft April 11, 2024 13:10
@dosubot dosubot bot added the bug Something isn't working label Apr 11, 2024
@RRap0so RRap0so marked this pull request as ready for review April 11, 2024 15:16
@RRap0so RRap0so marked this pull request as draft April 12, 2024 09:19
@RRap0so
Copy link
Contributor Author

RRap0so commented Apr 12, 2024

We're still investigating this, we found some odd behaviour when an execution is terminated too fast.

@RRap0so RRap0so closed this Apr 12, 2024
@RRap0so RRap0so deleted the fix_abort_array_task branch April 12, 2024 14:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working size:M This PR changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] MapTasks don't cleanup pods when aborting an execution
1 participant