Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow skipping some YAML tests #3069

Merged
merged 1 commit into from
Aug 19, 2020

Conversation

chmouel
Copy link
Member

@chmouel chmouel commented Aug 7, 2020

Allow skipping some of the yaml tests if the environment variable
TEST_EXAMPLES_IGNORES is set and match the regexp :

For example :

export TEST_EXAMPLES_IGNORES=".*clustertasks.*"

will skip all the kankiko examples yamls.

We have a need for this because we want to run the go yaml examples testsuite
but need to skip some of those tests that are not compatible with openshift due
of some restrictions on that system.

/kind misc
/area testing

Changes

Submitter Checklist

These are the criteria that every PR should meet, please check them off as you
review them:

  • Includes tests (if functionality changed/added)
  • Includes docs (if user facing)
  • Commit messages follow commit message best practices
  • Release notes block has been filled in or deleted (only if no user facing changes)

Release Note

NONE

@tekton-robot tekton-robot added the release-note Denotes a PR that will be considered when it comes time to generate release notes. label Aug 7, 2020
@tekton-robot tekton-robot requested review from dlorenc and a user August 7, 2020 09:27
@tekton-robot tekton-robot added the size/S Denotes a PR that changes 10-29 lines, ignoring generated files. label Aug 7, 2020
@chmouel chmouel force-pushed the alow-skipping-tests branch 3 times, most recently from 170070b to f9617a6 Compare August 7, 2020 09:31
@tekton-robot tekton-robot added kind/misc Categorizes issue or PR as a miscellaneuous one. area/testing Issues or PRs related to testing labels Aug 7, 2020
Allow skipping some of the yaml tests if the environment variable
TEST_EXAMPLES_IGNORES is set and match the regexp :

For example :

export TEST_EXAMPLES_IGNORES=".*clustertasks.*"

will skip all the kankiko examples yamls.

Signed-off-by: Chmouel Boudjnah <[email protected]>
@chmouel chmouel force-pushed the alow-skipping-tests branch from f9617a6 to 7b36913 Compare August 7, 2020 09:33
@tekton-robot tekton-robot added do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. release-note-none Denotes a PR that doesnt merit a release note. and removed release-note Denotes a PR that will be considered when it comes time to generate release notes. do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. labels Aug 7, 2020
test/examples_test.go Show resolved Hide resolved
test/examples_test.go Show resolved Hide resolved
@dlorenc
Copy link
Contributor

dlorenc commented Aug 14, 2020

/lgtm

@tekton-robot tekton-robot added the lgtm Indicates that a PR is ready to be merged. label Aug 14, 2020
Copy link
Contributor

@dlorenc dlorenc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two small nits.

test/examples_test.go Show resolved Hide resolved
re := regexp.MustCompile(val)
submatch := re.FindSubmatch([]byte(path))
if submatch != nil {
t.Logf("Skipping test %s", path)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does t.Skip work here?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dlorenc it would skip all the tests I think 🙃

Copy link
Member

@vdemeester vdemeester left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/meow

@tekton-robot
Copy link
Collaborator

@vdemeester: cat image

In response to this:

/meow

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@tekton-robot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: vdemeester

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@tekton-robot tekton-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 19, 2020
@tekton-robot tekton-robot merged commit 8df31f7 into tektoncd:master Aug 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/testing Issues or PRs related to testing kind/misc Categorizes issue or PR as a miscellaneuous one. lgtm Indicates that a PR is ready to be merged. release-note-none Denotes a PR that doesnt merit a release note. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants