Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unit test failure on config #2002

Closed
sozercan opened this issue Apr 18, 2022 · 3 comments
Closed

Unit test failure on config #2002

sozercan opened this issue Apr 18, 2022 · 3 comments
Labels
bug Something isn't working wontfix This will not be worked on

Comments

@sozercan
Copy link
Member

sozercan commented Apr 18, 2022 •
edited
Loading

What steps did you take and what happened:
[A clear and concise description of what the bug is.]

Looks like a flaky test

https://pipelines.actions.githubusercontent.com/serviceHosts/bec77a88-f18c-4f0a-bdc0-ac536d176b50/_apis/pipelines/1/runs/5028/signedlogcontent/17?urlExpires=2022-04-18T19%3A27%3A48.6175120Z&urlSigningMethod=HMACV1&urlSignature=oEd%2FNs3fv5uqSzLkVH5cvIZlTp%2BbHXwJ563JFkHAIzA%3D

2022-04-18T19:19:42.5603154Z ?   	github.com/open-policy-agent/gatekeeper/pkg/controller	[no test files]
2022-04-18T19:19:51.1287466Z 1.6503095911284344e+09	INFO	controller.sync-controller	Starting EventSource	{"source": "channel source: 0xc000b59450"}
2022-04-18T19:19:51.1293992Z 1.6503095911292431e+09	INFO	controller.sync-controller	Starting Controller
2022-04-18T19:19:51.1298038Z 1.6503095911296601e+09	INFO	controller.sync-controller	Starting workers	{"worker count": 1}
2022-04-18T19:19:51.1309345Z 1.6503095911307344e+09	INFO	controller.config-controller	Starting EventSource	{"source": "kind source: *v1alpha1.Config"}
2022-04-18T19:19:51.1313807Z 1.6503095911312714e+09	INFO	controller.config-controller	Starting Controller
2022-04-18T19:19:51.2154370Z 1.6503095912150583e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:19:51.2235510Z 1.6503095912232919e+09	DEBUG	readiness-tracker	config expectations populated
2022-04-18T19:19:51.2301078Z 1.6503095912298396e+09	DEBUG	readiness-tracker	expecting data	{"gvk": "/v1, Kind=Namespace", "namespace": "", "name": "default"}
2022-04-18T19:19:51.2302398Z 1.6503095912299545e+09	DEBUG	readiness-tracker	expecting data	{"gvk": "/v1, Kind=Namespace", "namespace": "", "name": "gatekeeper-system"}
2022-04-18T19:19:51.2304154Z 1.6503095912300081e+09	DEBUG	readiness-tracker	expecting data	{"gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-node-lease"}
2022-04-18T19:19:51.2305417Z 1.6503095912300563e+09	DEBUG	readiness-tracker	expecting data	{"gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-public"}
2022-04-18T19:19:51.2306434Z 1.650309591230101e+09	DEBUG	readiness-tracker	expecting data	{"gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-system"}
2022-04-18T19:19:51.2307428Z 1.65030959123014e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "/v1, Kind=Namespace", "expectationCount": 5}
2022-04-18T19:19:51.2361382Z 1.6503095912301831e+09	DEBUG	readiness-tracker	data expectations populated	{"gvk": "/v1, Kind=Namespace"}
2022-04-18T19:19:51.2362575Z 1.6503095912309065e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "/v1, Kind=Pod", "expectationCount": 0}
2022-04-18T19:19:51.2363344Z 1.6503095912309787e+09	DEBUG	readiness-tracker	data expectations populated	{"gvk": "/v1, Kind=Pod"}
2022-04-18T19:19:51.2364197Z 1.6503095912310503e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "config.gatekeeper.sh/v1alpha1, Kind=Config", "expectationCount": 2}
2022-04-18T19:19:51.2398735Z 1.6503095912395787e+09	INFO	controller.config-controller	Starting workers	{"worker count": 1}
2022-04-18T19:19:51.2400857Z 1.650309591239958e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:19:51.2887037Z 1.6503095912883549e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:19:51.3016496Z 1.650309591301408e+09	INFO	Stopping and waiting for non leader election runnables
2022-04-18T19:19:51.3037888Z 1.6503095913035448e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-system"}
2022-04-18T19:19:51.3048985Z 1.6503095913046966e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-public"}
2022-04-18T19:19:51.3069387Z 1.6503095913067272e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-node-lease"}
2022-04-18T19:19:51.3092960Z 1.6503095913054507e+09	INFO	Stopping and waiting for leader election runnables
2022-04-18T19:19:51.3095462Z 1.6503095913094141e+09	INFO	controller.config-controller	Shutdown signal received, waiting for all workers to finish
2022-04-18T19:19:51.3096569Z 1.6503095913095405e+09	INFO	controller.sync-controller	Shutdown signal received, waiting for all workers to finish
2022-04-18T19:19:51.3097891Z 1.6503095913096037e+09	ERROR	readiness-tracker	listing	{"gvk": "/, Kind=", "err": "timed out waiting for the condition", "error": "timed out waiting for the condition"}
2022-04-18T19:19:51.3098963Z github.com/open-policy-agent/gatekeeper/pkg/readiness.retryLister.func1
2022-04-18T19:19:51.3165633Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/list.go:68
2022-04-18T19:19:51.3166444Z github.com/open-policy-agent/gatekeeper/pkg/readiness.listerFunc.List
2022-04-18T19:19:51.3167099Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/list.go:32
2022-04-18T19:19:51.3167831Z github.com/open-policy-agent/gatekeeper/pkg/readiness.(*Tracker).trackConstraintTemplates
2022-04-18T19:19:51.3168417Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/ready_tracker.go:567
2022-04-18T19:19:51.3169090Z github.com/open-policy-agent/gatekeeper/pkg/readiness.(*Tracker).Run.func5
2022-04-18T19:19:51.3169722Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/ready_tracker.go:286
2022-04-18T19:19:51.3170171Z golang.org/x/sync/errgroup.(*Group).Go.func1
2022-04-18T19:19:51.3170772Z 	/home/runner/work/gatekeeper/gatekeeper/vendor/golang.org/x/sync/errgroup/errgroup.go:57
2022-04-18T19:19:51.3171993Z 1.6503095913097193e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "templates.gatekeeper.sh/v1beta1, Kind=ConstraintTemplate", "expectationCount": 0}
2022-04-18T19:19:51.3173171Z 1.6503095913097725e+09	DEBUG	readiness-tracker	template expectations populated
2022-04-18T19:19:51.3173840Z 1.650309591310567e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "default"}
2022-04-18T19:19:51.3174786Z 1.6503095913111713e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "gatekeeper-system"}
2022-04-18T19:19:51.3175520Z 1.6503095913117423e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "testns"}
2022-04-18T19:19:51.3176230Z 1.650309591312005e+09	INFO	controller.sync-controller	All workers finished
2022-04-18T19:20:21.3025059Z 1.6503096213016868e+09	INFO	Stopping and waiting for caches
2022-04-18T19:20:21.3055754Z --- FAIL: TestReconcile (30.33s)
2022-04-18T19:20:21.3057533Z     manager.go:29: running Manager: failed waiting for all runnables to end within grace period of 30s: context deadline exceeded
2022-04-18T19:20:21.3058754Z 1.6503096213020227e+09	INFO	Stopping and waiting for webhooks
2022-04-18T19:20:21.3059742Z 1.6503096213022673e+09	INFO	Wait completed, proceeding to shutdown the manager
2022-04-18T19:20:21.3060701Z 1.6503096213024538e+09	INFO	controller	Running test: Cancel the expectations when sync only resource gets deleted	{"kind": "Config"}
2022-04-18T19:20:21.3625767Z 1.6503096213622484e+09	INFO	controller.sync-controller	Starting EventSource	{"source": "channel source: 0xc000a801e0"}
2022-04-18T19:20:21.3656818Z 1.6503096213654702e+09	INFO	controller.sync-controller	Starting Controller
2022-04-18T19:20:21.3658026Z 1.650309621365536e+09	INFO	controller.sync-controller	Starting workers	{"worker count": 1}
2022-04-18T19:20:21.3712642Z 1.6503096213634117e+09	INFO	controller.config-controller	Starting EventSource	{"source": "kind source: *v1alpha1.Config"}
2022-04-18T19:20:21.3713561Z 1.6503096213657434e+09	INFO	controller.config-controller	Starting Controller
2022-04-18T19:20:21.3817049Z 1.6503096213813262e+09	DEBUG	readiness-tracker	config expectations populated
2022-04-18T19:20:21.4108712Z 1.6503096214100823e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:21.4147121Z 1.650309621414453e+09	DEBUG	readiness-tracker	expecting data	{"gvk": "/v1, Kind=Pod", "namespace": "default", "name": "testpod"}
2022-04-18T19:20:21.4148474Z 1.6503096214146035e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "/v1, Kind=Pod", "expectationCount": 1}
2022-04-18T19:20:21.4150364Z 1.650309621414667e+09	DEBUG	readiness-tracker	data expectations populated	{"gvk": "/v1, Kind=Pod"}
2022-04-18T19:20:21.4151628Z 1.6503096214147353e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "config.gatekeeper.sh/v1alpha1, Kind=Config", "expectationCount": 1}
2022-04-18T19:20:21.4199172Z 1.6503096214197063e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.4379352Z 1.6503096214377344e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.4483385Z 1.6503096214481022e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.4589521Z 1.650309621458715e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.4595929Z 1.6503096214593573e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:21.4692290Z 1.6503096214689896e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.4796268Z 1.650309621479421e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.4901207Z 1.6503096214897895e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.5005653Z 1.650309621500315e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.5118363Z 1.650309621511495e+09	INFO	controller.config-controller	Starting workers	{"worker count": 1}
2022-04-18T19:20:21.5125108Z 1.6503096215122283e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/1"}
2022-04-18T19:20:21.5180450Z 1.6503096215177708e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:21.5195630Z 1.6503096215193343e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:21.5470916Z 1.65030962154675e+09	DEBUG	readiness-tracker	resolved pre-observations	{"gvk": "/v1, Kind=Pod", "count": 0}
2022-04-18T19:20:21.5471898Z 1.6503096215470505e+09	DEBUG	readiness-tracker	readiness state	{"gvk": "/v1, Kind=Pod", "satisfied": "0/0"}
2022-04-18T19:20:21.5475474Z 1.650309621547349e+09	DEBUG	readiness-tracker	all expectations satisfied	{"gvk": "/v1, Kind=Pod"}
2022-04-18T19:20:21.5530103Z 1.6503096215494065e+09	INFO	Stopping and waiting for non leader election runnables
2022-04-18T19:20:21.5534165Z 1.650309621549786e+09	INFO	Stopping and waiting for leader election runnables
2022-04-18T19:20:21.5535601Z 1.6503096215500035e+09	INFO	controller.config-controller	Shutdown signal received, waiting for all workers to finish
2022-04-18T19:20:21.5536642Z 1.6503096215500576e+09	INFO	controller.sync-controller	Shutdown signal received, waiting for all workers to finish
2022-04-18T19:20:21.5537395Z 1.6503096215501657e+09	INFO	controller.config-controller	All workers finished
2022-04-18T19:20:21.5538082Z 1.650309621550341e+09	INFO	controller.sync-controller	All workers finished
2022-04-18T19:20:21.5662940Z 1.6503096215658512e+09	ERROR	readiness-tracker	listing	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\"", "error": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:21.5664021Z github.com/open-policy-agent/gatekeeper/pkg/readiness.retryLister.func1
2022-04-18T19:20:21.5664772Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/list.go:68
2022-04-18T19:20:21.5665472Z github.com/open-policy-agent/gatekeeper/pkg/readiness.listerFunc.List
2022-04-18T19:20:21.5666063Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/list.go:32
2022-04-18T19:20:21.5666786Z github.com/open-policy-agent/gatekeeper/pkg/readiness.(*Tracker).trackConstraintTemplates
2022-04-18T19:20:21.5667407Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/ready_tracker.go:567
2022-04-18T19:20:21.5668098Z github.com/open-policy-agent/gatekeeper/pkg/readiness.(*Tracker).Run.func5
2022-04-18T19:20:21.5668691Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/ready_tracker.go:286
2022-04-18T19:20:21.5669131Z golang.org/x/sync/errgroup.(*Group).Go.func1
2022-04-18T19:20:21.5669725Z 	/home/runner/work/gatekeeper/gatekeeper/vendor/golang.org/x/sync/errgroup/errgroup.go:57
2022-04-18T19:20:21.5674281Z 1.65030962156712e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "templates.gatekeeper.sh/v1beta1, Kind=ConstraintTemplate", "expectationCount": 0}
2022-04-18T19:20:21.5677151Z 1.6503096215675762e+09	DEBUG	readiness-tracker	template expectations populated
2022-04-18T19:20:21.5681155Z 1.6503096215679636e+09	INFO	Stopping and waiting for caches
2022-04-18T19:20:21.5688119Z 1.6503096215686405e+09	INFO	Stopping and waiting for webhooks
2022-04-18T19:20:21.5694790Z 1.6503096215693297e+09	INFO	Wait completed, proceeding to shutdown the manager
2022-04-18T19:20:21.6237183Z 1.650309621623376e+09	INFO	controller.config-controller	Starting EventSource	{"source": "kind source: *v1alpha1.Config"}
2022-04-18T19:20:21.6249256Z 1.6503096216243548e+09	INFO	controller.config-controller	Starting Controller
2022-04-18T19:20:21.6257723Z 1.6503096216255522e+09	INFO	controller.sync-controller	Starting EventSource	{"source": "channel source: 0xc000a20a00"}
2022-04-18T19:20:21.6268008Z 1.650309621626652e+09	INFO	controller.sync-controller	Starting Controller
2022-04-18T19:20:21.6271597Z 1.6503096216269827e+09	INFO	controller.sync-controller	Starting workers	{"worker count": 1}
2022-04-18T19:20:21.6285106Z 1.6503096216282518e+09	INFO	readiness-tracker	config resource not found - skipping for readiness
2022-04-18T19:20:21.6285838Z 1.6503096216283293e+09	DEBUG	readiness-tracker	config expectations populated
2022-04-18T19:20:21.6288385Z 1.6503096216283698e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "config.gatekeeper.sh/v1alpha1, Kind=Config", "expectationCount": 0}
2022-04-18T19:20:21.6702736Z 1.6503096216684895e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:21.7231848Z 1.650309621722787e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:21.7709855Z 1.6503096217705946e+09	INFO	controller.config-controller	Starting workers	{"worker count": 1}
2022-04-18T19:20:21.7711721Z 1.6503096217710357e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:21.7800645Z 1.6503096217797751e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=ConfigMap", "namespace": "default", "name": "config-test-1"}
2022-04-18T19:20:21.7822756Z 1.6503096217820215e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "gatekeeper-system"}
2022-04-18T19:20:21.7835540Z 1.6503096217827919e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "testns"}
2022-04-18T19:20:21.7842963Z 1.6503096217841077e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-public"}
2022-04-18T19:20:21.7848986Z 1.6503096217847278e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-node-lease"}
2022-04-18T19:20:21.7855030Z 1.6503096217853656e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "default"}
2022-04-18T19:20:21.8222350Z 1.650309621821991e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:21.8223930Z 1.650309621822109e+09	DEBUG	readiness-tracker	cancel tracking for data	{"gvk": "/v1, Kind=Namespace"}
2022-04-18T19:20:21.8225507Z 1.6503096218224347e+09	INFO	watch-manager	all watches removed for gvk, waiting for replays to end	{"gvk": "/v1, Kind=Namespace"}
2022-04-18T19:20:21.8226589Z 1.650309621822527e+09	INFO	watch-manager	watch removed	{"gvk": "/v1, Kind=Namespace"}
2022-04-18T19:20:21.8252189Z 1.65030962182486e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:21.8359608Z 1.6503096218357518e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:21.8361711Z 1.6503096218358712e+09	DEBUG	readiness-tracker	cancel tracking for data	{"gvk": "/v1, Kind=ConfigMap"}
2022-04-18T19:20:21.8366649Z 1.650309621836412e+09	INFO	watch-manager	all watches removed for gvk, waiting for replays to end	{"gvk": "/v1, Kind=ConfigMap"}
2022-04-18T19:20:21.8372238Z 1.650309621836521e+09	INFO	watch-manager	watch removed	{"gvk": "/v1, Kind=ConfigMap"}
2022-04-18T19:20:21.8536210Z 1.6503096218530827e+09	INFO	Stopping and waiting for non leader election runnables
2022-04-18T19:20:21.8537308Z 1.6503096218534505e+09	INFO	Stopping and waiting for leader election runnables
2022-04-18T19:20:21.8542684Z 1.6503096218539364e+09	INFO	controller.sync-controller	Shutdown signal received, waiting for all workers to finish
2022-04-18T19:20:21.8544872Z 1.6503096218540168e+09	INFO	controller.config-controller	Shutdown signal received, waiting for all workers to finish
2022-04-18T19:20:21.8546160Z 1.6503096218540726e+09	INFO	controller.config-controller	All workers finished
2022-04-18T19:20:21.8547128Z 1.6503096218545315e+09	INFO	controller.sync-controller	All workers finished
2022-04-18T19:20:21.8551455Z 1.65030962185488e+09	ERROR	readiness-tracker	listing	{"gvk": "/, Kind=", "err": "timed out waiting for the condition", "error": "timed out waiting for the condition"}
2022-04-18T19:20:21.8552554Z github.com/open-policy-agent/gatekeeper/pkg/readiness.retryLister.func1
2022-04-18T19:20:21.8626676Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/list.go:68
2022-04-18T19:20:21.8627517Z github.com/open-policy-agent/gatekeeper/pkg/readiness.listerFunc.List
2022-04-18T19:20:21.8628145Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/list.go:32
2022-04-18T19:20:21.8628966Z github.com/open-policy-agent/gatekeeper/pkg/readiness.(*Tracker).trackConstraintTemplates
2022-04-18T19:20:21.8653244Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/ready_tracker.go:567
2022-04-18T19:20:21.8654076Z github.com/open-policy-agent/gatekeeper/pkg/readiness.(*Tracker).Run.func5
2022-04-18T19:20:21.8654800Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/ready_tracker.go:286
2022-04-18T19:20:21.8655246Z golang.org/x/sync/errgroup.(*Group).Go.func1
2022-04-18T19:20:21.8655845Z 	/home/runner/work/gatekeeper/gatekeeper/vendor/golang.org/x/sync/errgroup/errgroup.go:57
2022-04-18T19:20:21.8656778Z 1.650309621855019e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "templates.gatekeeper.sh/v1beta1, Kind=ConstraintTemplate", "expectationCount": 0}
2022-04-18T19:20:21.8657610Z 1.6503096218550715e+09	DEBUG	readiness-tracker	template expectations populated
2022-04-18T19:20:21.8658155Z 1.65030962185574e+09	INFO	Stopping and waiting for caches
2022-04-18T19:20:21.8658637Z 1.650309621856224e+09	INFO	Stopping and waiting for webhooks
2022-04-18T19:20:21.8659143Z 1.6503096218567398e+09	INFO	Wait completed, proceeding to shutdown the manager
2022-04-18T19:20:21.9101009Z 1.6503096219097817e+09	INFO	controller.sync-controller	Starting EventSource	{"source": "channel source: 0xc000c897c0"}
2022-04-18T19:20:21.9102534Z 1.6503096219100635e+09	INFO	controller.sync-controller	Starting Controller
2022-04-18T19:20:21.9103408Z 1.6503096219101107e+09	INFO	controller.sync-controller	Starting workers	{"worker count": 1}
2022-04-18T19:20:21.9109457Z 1.6503096219107764e+09	INFO	controller.config-controller	Starting EventSource	{"source": "kind source: *v1alpha1.Config"}
2022-04-18T19:20:21.9110407Z 1.6503096219109328e+09	INFO	controller.config-controller	Starting Controller
2022-04-18T19:20:21.9142901Z 1.6503096219140298e+09	DEBUG	readiness-tracker	config expectations populated
2022-04-18T19:20:21.9570391Z 1.6503096219538224e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:21.9613169Z 1.6503096219609983e+09	DEBUG	readiness-tracker	expecting data	{"gvk": "/v1, Kind=ConfigMap", "namespace": "kube-system", "name": "extension-apiserver-authentication"}
2022-04-18T19:20:21.9617153Z 1.6503096219610996e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "/v1, Kind=ConfigMap", "expectationCount": 1}
2022-04-18T19:20:21.9620892Z 1.6503096219616344e+09	DEBUG	readiness-tracker	data expectations populated	{"gvk": "/v1, Kind=ConfigMap"}
2022-04-18T19:20:21.9622727Z 1.6503096219621215e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "config.gatekeeper.sh/v1alpha1, Kind=Config", "expectationCount": 1}
2022-04-18T19:20:22.0087408Z 1.6503096220083292e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:22.0567474Z 1.6503096220563338e+09	INFO	controller.config-controller	Starting workers	{"worker count": 1}
2022-04-18T19:20:22.0571749Z 1.650309622056996e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:22.0640282Z 1.6503096220632963e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=ConfigMap", "namespace": "default", "name": "config-test-1"}
2022-04-18T19:20:22.1096484Z 1.6503096221093466e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:22.1108354Z 1.650309622110483e+09	DEBUG	readiness-tracker	transient issue while listing, retrying...	{"gvk": "/, Kind=", "err": "no matches for kind \"ConstraintTemplate\" in version \"templates.gatekeeper.sh/v1beta1\""}
2022-04-18T19:20:22.1117843Z 1.6503096221114116e+09	ERROR	controller.config-controller	Reconciler error	{"name": "config", "namespace": "gatekeeper-system", "error": "replaying data: replaying data for /v1, Kind=ConfigMap: synthetic failure"}
2022-04-18T19:20:22.1119186Z sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
2022-04-18T19:20:22.1130442Z 	/home/runner/work/gatekeeper/gatekeeper/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:266
2022-04-18T19:20:22.1131752Z sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
2022-04-18T19:20:22.1133846Z 	/home/runner/work/gatekeeper/gatekeeper/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:227
2022-04-18T19:20:22.1183621Z 1.65030962211802e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "gatekeeper-system"}
2022-04-18T19:20:22.1197591Z 1.6503096221195781e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "testns"}
2022-04-18T19:20:22.1200701Z 1.6503096221199358e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-public"}
2022-04-18T19:20:22.1202779Z 1.6503096221201448e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "kube-node-lease"}
2022-04-18T19:20:22.1204667Z 1.6503096221203606e+09	DEBUG	controller	[readiness] observed data	{"metaKind": "Sync", "gvk": "/v1, Kind=Namespace", "namespace": "", "name": "default"}
2022-04-18T19:20:22.1207915Z 1.6503096221192522e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:22.1298055Z 1.6503096221296287e+09	INFO	Stopping and waiting for non leader election runnables
2022-04-18T19:20:22.1303518Z 1.6503096221302276e+09	INFO	Stopping and waiting for leader election runnables
2022-04-18T19:20:22.1307595Z 1.6503096221303155e+09	INFO	controller	disabling readiness stats	{"kind": "Config"}
2022-04-18T19:20:22.1308711Z 1.6503096221307263e+09	DEBUG	readiness-tracker	cancel tracking for data	{"gvk": "/v1, Kind=Namespace"}
2022-04-18T19:20:22.1309643Z 1.6503096221307938e+09	DEBUG	readiness-tracker	cancel tracking for data	{"gvk": "/v1, Kind=ConfigMap"}
2022-04-18T19:20:22.1311509Z 1.6503096221310377e+09	INFO	watch-manager	all watches removed for gvk, waiting for replays to end	{"gvk": "/v1, Kind=ConfigMap"}
2022-04-18T19:20:22.1312426Z 1.6503096221311214e+09	INFO	watch-manager	watch removed	{"gvk": "/v1, Kind=ConfigMap"}
2022-04-18T19:20:22.1324592Z 1.6503096221321945e+09	INFO	controller.config-controller	Shutdown signal received, waiting for all workers to finish
2022-04-18T19:20:22.1327449Z 1.650309622132537e+09	ERROR	readiness-tracker	listing	{"gvk": "/, Kind=", "err": "timed out waiting for the condition", "error": "timed out waiting for the condition"}
2022-04-18T19:20:22.1328699Z github.com/open-policy-agent/gatekeeper/pkg/readiness.retryLister.func1
2022-04-18T19:20:22.1330032Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/list.go:68
2022-04-18T19:20:22.1331199Z github.com/open-policy-agent/gatekeeper/pkg/readiness.listerFunc.List
2022-04-18T19:20:22.1332367Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/list.go:32
2022-04-18T19:20:22.1425691Z github.com/open-policy-agent/gatekeeper/pkg/readiness.(*Tracker).trackConstraintTemplates
2022-04-18T19:20:22.1426361Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/ready_tracker.go:567
2022-04-18T19:20:22.1427061Z github.com/open-policy-agent/gatekeeper/pkg/readiness.(*Tracker).Run.func5
2022-04-18T19:20:22.1427768Z 	/home/runner/work/gatekeeper/gatekeeper/pkg/readiness/ready_tracker.go:286
2022-04-18T19:20:22.1428229Z golang.org/x/sync/errgroup.(*Group).Go.func1
2022-04-18T19:20:22.1428808Z 	/home/runner/work/gatekeeper/gatekeeper/vendor/golang.org/x/sync/errgroup/errgroup.go:57
2022-04-18T19:20:22.1429747Z 1.6503096221326885e+09	INFO	readiness-tracker	ExpectationsDone	{"gvk": "templates.gatekeeper.sh/v1beta1, Kind=ConstraintTemplate", "expectationCount": 0}
2022-04-18T19:20:22.1431478Z 1.650309622132746e+09	DEBUG	readiness-tracker	template expectations populated
2022-04-18T19:20:22.1432298Z 1.6503096221334884e+09	INFO	watch-manager	all watches removed for gvk, waiting for replays to end	{"gvk": "/v1, Kind=Namespace"}
2022-04-18T19:20:22.1433750Z 1.6503096221336024e+09	INFO	watch-manager	watch removed	{"gvk": "/v1, Kind=Namespace"}
2022-04-18T19:20:22.1434417Z 1.6503096221337304e+09	INFO	controller.config-controller	All workers finished
2022-04-18T19:20:22.1435188Z 1.6503096221322129e+09	INFO	controller.sync-controller	Shutdown signal received, waiting for all workers to finish
2022-04-18T19:20:22.1435912Z 1.6503096221346812e+09	INFO	controller.sync-controller	All workers finished
2022-04-18T19:20:22.1436457Z 1.6503096221348057e+09	INFO	Stopping and waiting for caches
2022-04-18T19:20:22.1437691Z 1.650309622135118e+09	INFO	Stopping and waiting for webhooks
2022-04-18T19:20:22.1438804Z 1.6503096221354473e+09	INFO	Wait completed, proceeding to shutdown the manager
2022-04-18T19:20:22.1439235Z FAIL
2022-04-18T19:20:22.1439687Z coverage: 75.8% of statements
2022-04-18T19:20:22.1655486Z exit status 1
2022-04-18T19:20:22.1656556Z FAIL	github.com/open-policy-agent/gatekeeper/pkg/controller/config	38.251s

What did you expect to happen:

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

Environment:

  • Gatekeeper version:
  • Kubernetes version: (use kubectl version):
@sozercan sozercan added the bug Something isn't working label Apr 18, 2022
@maxsmythe
Copy link
Contributor

Did the manager have trouble tearing processes down?

manager.go:29: running Manager: failed waiting for all runnables to end within grace period of 30s: context deadline exceeded

@mrjoelkamp
Copy link

Could this be related to #2026 ?

It looks like we are having issues with config excluding all namespaces

@mrjoelkamp mrjoelkamp mentioned this issue May 3, 2022
Closed
@stale
Copy link

stale bot commented Jul 23, 2022

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 14 days if no further activity occurs. Thank you for your contributions.

@stale stale bot added the wontfix This will not be worked on label Jul 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working wontfix This will not be worked on
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@sozercan @mrjoelkamp @maxsmythe