fedora: cc-runtime list stops working and qemu and CC processes are left behind after running swarm #902
Comments
|
This is mainly why we have the Openshift test failing on our jenkins CI. |
|
Hi @chavafg - this is pretty weird. Could you get any further insight into which scenario we might be hitting if you add some debug to |
|
From what I can see is that we are seeing the scenario where the directory has already been deleted (from the swarm execution) because if Openshift is executed alone (no swarm tests executed prior Openshift), this error does not appear. |
|
Thanks @chavafg. It does sound like your error handling for I also noticed that we're not doing exactly what |
|
#907 raised to be a bit more lenient if |
|
@chavafg can you confirm this happend with all distros or just in fedora. I tried to reproduce it in ubuntu 16.04 and cc-runtime list is still working and not qemu instances are left. |
|
@jcvenegas I confirm that this only happens when running with Fedora |
jcvenegas
changed the title
|
@chavafg , Great that narrows the search space. So by looking at We have some issues trying to stop a container (and probably delete) , lets try to get a complete runtime log from a swarm testsuite to know what is going on. |
This is a workarrond to allow the ci work until clearcontainers/runtime#902 is fixed Fixes: clearcontainers#835 Signed-off-by: Jose Carlos Venegas Munoz <[email protected]>
|
Hi @chavafg - is this still a problem? |
Description of problem
After swarm tests are executed in the CI, the
cc-runtime listcommand does not work and there areqemu,cc-proxyandcc-shimprocesses left behind.Expected result
cc-runtime listshould workno processes should left behind.
Actual result
Swarm tests executed:
cc-runtime list failure:
docker ps -a:processes left:
[fuentess@ci-failure tests]$ sudo -E PATH=$PATH cc-collect-data.sh
Meta details
Running
cc-collect-data.shversion3.0.12 (commit be7d1cebb5e8afbb2a9329264d4163adc70b0362)at2018-01-08.16:00:02.709520618+0000.Runtime is
/usr/local/bin/cc-runtime.cc-envOutput of "
/usr/local/bin/cc-runtime cc-env":Runtime config files
Runtime default config files
Runtime config file contents
Config file
/etc/clear-containers/configuration.tomlnot foundOutput of "
cat "/usr/share/defaults/clear-containers/configuration.toml"":Logfiles
Runtime logs
Recent runtime problems found in system journal:
Proxy logs
No recent proxy problems found in system journal.
Shim logs
Recent shim problems found in system journal:
Container manager details
Have
dockerDocker
Output of "
docker version":Output of "
docker info":Output of "
systemctl show docker":No
kubectlPackages
No
dpkgHave
rpmOutput of "
rpm -qa|egrep "(cc-proxy|cc-runtime|cc-shim|clear-containers-image|linux-container|qemu-lite|qemu-system-x86|cc-oci-runtime)"":The text was updated successfully, but these errors were encountered: