Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancement: Include listing of test case failures within the test target when it is available #841

Open
smlambert opened this issue Mar 4, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@smlambert
Copy link
Contributor

We currently track which test targets fail and keep a snippet of console output per target in the TRSS database.

For certain groups of tests like openjdk and jck we can summarize the list of testcase failures in the TAP file (and/or to console).

Currently, we have to inspect the console output to see if a particular target is failing with the same underlying set of test cases or not from run to run and across platforms.

We should consider pushing the summarized list of testcase failures to console (at the same time we are writing the list to the TAP file, see these related PRs in TKG). Then grabbing that console output and storing it in the TRSS database for querying and comparison between results in the GUI.

This may help us hone in on when root causes for certain failures are introduced.

@sophia-guo
Copy link
Contributor

We should consider pushing the summarized list of testcase failures to console

This should be done in TKG. adoptium/TKG#536

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Todo
Development

No branches or pull requests

2 participants