Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Aborted job does not have correct test summary #929

Closed
llxia opened this issue Nov 1, 2024 · 0 comments · Fixed by #930
Closed

Aborted job does not have correct test summary #929

llxia opened this issue Nov 1, 2024 · 0 comments · Fixed by #930
Assignees

Comments

@llxia
Copy link
Contributor

llxia commented Nov 1, 2024

In the image below, one test job was aborted, but the tooltip shows failed: 0

image

allTestsInfo page does show the failed test.

TRSS gets the summary from the console output (test summary from TKG) (i.e., 02:13:29.211 TOTAL: 88 EXECUTED: 88 PASSED: 88 FAILED: 0 DISABLED: 0 SKIPPED: 0). In the case of abort/time out, the test build did not run to completion. There was no summary in the console output. Therefore, there was no data in DB.

image

To highlight the failure, TRSS can also generate the test summary from the console output. However, if console output is not correct, test summary from TRSS may not be correct. This happened before, where the console output contained duplicate test information.

Therefore, use test summary from TKG as default (it is more reliable). If TKG test summary does not exist (abort/timeout case), use test summary from TRSS.

@llxia llxia self-assigned this Nov 1, 2024
llxia added a commit to llxia/aqa-test-tools that referenced this issue Nov 4, 2024
resolves: adoptium#929

Signed-off-by: Lan Xia <[email protected]>
LongyuZhang pushed a commit that referenced this issue Nov 4, 2024
resolves: #929

Signed-off-by: Lan Xia <[email protected]>
llxia added a commit to llxia/aqa-tests that referenced this issue Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant