software bug: "too many open files"

[weizhoublue]

spiderpool controller pod exits when startup , it is easy to reproduce when replicas number bigger than 2

root@172-17-8-10:/home/git/spiderpool# kubectl logs -n kube-system   spiderpool-controller-5d56bcd8c8-x7v6c -p
{"level":"INFO","ts":"2022-08-18T07:03:43.069Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:63","msg":"gops is listening on 127.0.0.1:5724 "}
{"level":"INFO","ts":"2022-08-18T07:03:43.069Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:69","msg":"pyroscope works in push mode, server http://172.19.0.1:4040 "}
[INFO]  starting profiling session:
[INFO]    AppName:        spiderpool-controller
[INFO]    Tags:           map[node:spider-worker]
[INFO]    ProfilingTypes: [cpu alloc_objects alloc_space inuse_objects inuse_space]
[INFO]    DisableGCRuns:  false
[INFO]    SampleRate:     100
[INFO]    UploadRate:     10s
[DEBUG] profiling session reset 2022-08-18 07:03:30 +0000 UTC
{"level":"INFO","ts":"2022-08-18T07:03:43.070Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:92","msg":"Begin to initialize spiderpool-controller CRD Manager"}
{"level":"INFO","ts":"2022-08-18T07:03:43.464Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:99","msg":"Begin to initialize k8s Clientset"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.465Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:174","msg":"Begin to initialize spiderpool controller leader election"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.466Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:177","msg":"Begin to initialize WorkloadEndpoint Manager"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.466Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:187","msg":"Begin to initialize ReservedIP Manager"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.466Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:194","msg":"Begin to set up ReservedIP webhook"}
{"level":"INFO","ts":"2022-08-18T07:03:43.466Z","logger":"Lease-Lock-Election","caller":"election/lease_election.go:162","msg":"'kube-system/spiderpool-controller-leases/spiderpool-controller-5d56bcd8c8-x7v6c' is trying to elect"}
I0818 07:03:43.467328       1 leaderelection.go:248] attempting to acquire leader lease kube-system/spiderpool-controller-leases...
{"level":"DEBUG","ts":"2022-08-18T07:03:43.468Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:200","msg":"Begin to initialize Node Manager"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.468Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:207","msg":"Begin to initialize Namespace Manager"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.468Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:214","msg":"Begin to initialize Pod Manager"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.468Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:221","msg":"Begin to initialize StatefulSet Manager"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.468Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:228","msg":"Begin to initialize IPPool Manager"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.468Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:237","msg":"Begin to set up IPPool reconcile"}
{"level":"DEBUG","ts":"2022-08-18T07:03:43.468Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:244","msg":"Begin to set up IPPool webhook"}
{"level":"INFO","ts":"2022-08-18T07:03:43.470Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:116","msg":"Begin to initialize http server"}
{"level":"INFO","ts":"2022-08-18T07:03:43.470Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:110","msg":"Starting spiderpool-controller CRD Manager"}
{"level":"FATAL","ts":"2022-08-18T07:03:43.473Z","logger":"spiderpool-controller","caller":"cmd/daemon.go:112","msg":"too many open files"}

[weizhoublue]

maybe owing to kind
kubeflow/manifests#2087