Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Non-Default Module Testing #5

Open
rnveach opened this issue Jun 5, 2017 · 0 comments
Open

Non-Default Module Testing #5

rnveach opened this issue Jun 5, 2017 · 0 comments
Assignees

Comments

@rnveach
Copy link
Member

rnveach commented Jun 5, 2017

We need to go beyond default module testing and dive changing property values.
Reason can be seen at checkstyle/checkstyle#3656 (comment) .

We can already identify properties, but how are going to decide what values to set? Booleans are easy since they only have 2 values, but what about regular expression strings or files.
Should we hardcode some possible values and randomize the rest? Can we scan tests for property values?

How will testing multiple versions of the same module be handled for reporting as we need to know the results for the specific version of the module being checked.
If we build multiple configurations for multiple module versions, regression runtime will take longer.

We can request changes to make this faster/better in main checkstyle repo if it is reasonable.

This is blocked by default module testing.

@rnveach rnveach changed the title Non-Default Configuration Testing Non-Default Module Testing Jun 5, 2017
This was referenced Jun 5, 2017
This was referenced Jun 15, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants