GPU

[abdcef]

I get this error message:
docker: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy' nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown.

[ahmetoner]

Hello @abdcef,

Thank you for reporting, could you please describe your environment?

Distribution name and version (e.g. Ubuntu 18.10):
NVIDIA driver/Cuda version:
GPU (e.g. Asus Strix OC 1080 Ti):
Repository docker image version:
Docker run command:

Ahmet

[abdcef]

Thanks. The run command was docker run -d --gpus all -p 9000:9000 -e ASR_MODEL=base onerahmet/openai-whisper-asr-webservice:latest-gpu

[autolyticus]

GPU passthrough does not work on macOS due to fundamental design limitations of Docker. Docker actually runs containers within a LinuxVM on macOS. If you wish to run GPU-accelerated containers, I'm afraid Linux is your only option.

Cf. NVIDIA/nvidia-container-runtime#133

[abdcef]

Thanks for letting me know