Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split AWS jobs even more #962

Merged
merged 3 commits into from
Jul 1, 2021
Merged

Conversation

jillr
Copy link
Collaborator

@jillr jillr commented Jun 18, 2021

Group 2 is timing out a lot

@jillr
Copy link
Collaborator Author

jillr commented Jun 25, 2021

@goneri Can you confirm there's no other way I can do this? On community.aws right now with 5 splits I have 3 jobs that take <23 minutes but 1 that takes more than an hour - so I have to try 6 splits. We're going to be at risk of hitting API call thresholds at this rate.

I know which test suites shouldn't be in the same group but I don't know any way to manually assign tests to groups in zuul like we could with shippable. Is there something I could be doing to have more control over this?

@goneri
Copy link
Collaborator

goneri commented Jun 25, 2021

@goneri Can you confirm there's no other way I can do this? On community.aws right now with 5 splits I have 3 jobs that take <23 minutes but 1 that takes more than an hour - so I have to try 6 splits. We're going to be at risk of hitting API call thresholds at this rate.

I know which test suites shouldn't be in the same group but I don't know any way to manually assign tests to groups in zuul like we could with shippable. Is there something I could be doing to have more control over this?

We can certainly improve this. The split is done here: https://github.com/ansible/ansible-zuul-jobs/blob/master/roles/ansible-test/tasks/split_targets.yaml#L2

Can we split up this longer test targets? e.g split up slow-test in slow-test-part1 and slow-test-part2?

@goneri
Copy link
Collaborator

goneri commented Jun 28, 2021

Every time we increase the number of // job we also increase the CI resource consumption. We also get closer to the situation where we can hit API rate limit problems. At this stage, I would prefer we put this PR on hold and wait a bit to see how #969 improve the situation. We can also split up these slow targets.

@goneri goneri added the gate label Jul 1, 2021
@ansible-zuul ansible-zuul bot merged commit 00747e1 into ansible:master Jul 1, 2021
ansible-zuul bot pushed a commit to ansible-collections/amazon.aws that referenced this pull request Jul 2, 2021
Migrates scenario guide from ansible/ansible repo

SUMMARY
Related to ansible-community/antsibull-build#255.
Do we need to rename the page index.rst? Or add an index.rst file?
Also needs a PR against ansible/ansible removing this content from there.
ISSUE TYPE

Docs Pull Request

COMPONENT NAME
docs.ansible.com
Depends-On: ansible/ansible-zuul-jobs#962

Reviewed-by: Mark Chappell <None>
Reviewed-by: Alicia Cozine <None>
Reviewed-by: Jill R <None>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants