-
Notifications
You must be signed in to change notification settings - Fork 192
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CI: Increase timeout for test-install test suite. #4697
Conversation
The current timeout of 35min is regularly exceeded resulting in test failures. This change increases it to 55min.
Codecov Report
@@ Coverage Diff @@
## develop #4697 +/- ##
===========================================
+ Coverage 79.62% 79.63% +0.01%
===========================================
Files 484 484
Lines 35831 35831
===========================================
+ Hits 28527 28529 +2
+ Misses 7304 7302 -2
Flags with carried forward coverage won't be shown. Click here to find out more.
Continue to review full report at Codecov.
|
There appears to be some issue with the pre-commit upstream. I'll just rebase and rerun this later today. |
Hopefully this helps, but this is not really the underlying cause of the issue. It is because we have too many test jobs, which ends up causing some to go very slow (or even hang) |
This is primarily to address the failure of scheduled nightly runs which should not really be affected by our general workload. |
As a related note, we could host our own runner which might alleviate the situation. |
Oh it is definitely to do with the work load; the pytest suite only took < 12 minutes to run for all other jobs in the matrix, but the failing job got killed at 31 minutes: https://github.com/aiidateam/aiida-core/runs/1803637702?check_suite_focus=true. I have had this happen numerous times in the last few weeks. No problem to increase the timeout, but I would also suggest for this workflow, you can now drop the python 3.6 jobs, inline with #4691
I was looking into that for replacing Jenkins, but it has a number of security implications, and in the documentation it basically suggests to only use your own runner on private repositories |
What I mean is that the runners reserved for this repository should be exclusively used for the scheduled
I am planning on tackling that as part of the upcoming coding week.
Oh wow, that's really bad. I hope that they will work on that. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
let me know when you have fixed the pre-commit 😄
Started seeing this in other PRs as well (cc @ltalirz), possible dependency version change? |
It appears |
Fixing in #4700 |
yes, numpy 1.20 has been released https://numpy.org/doc/1.20/release/1.20.0-notes.html already broke pymatgen ;-) |
No surprise there 😆 |
I believe this problem is actually related to #4731 which I would like to prioritize to resolve. |
The current timeout of 35min is regularly exceeded resulting in test failures. This change increases it to 55min.