https://github.com/NVIDIA/nvidia-docker/issues/1268#issuecomment-632692949 I originally posted a similar answer here, but hopefully this clears things up: NVIDIA/k8s-device-plugin#168 (comment) The set of packages collectively referred to as nvidia-docker consists of the following components (and their dependencies from top to bottom): nvidia-docker2 nvidia-container-runtime nvidia-container-toolkit libnvidia-container Unfortunately, the documentation across the repos that host code for these projects is inconsistent and misleading at times. Some places say that nvidia-docker2 should no longer be installed for docker versions 19.03+ because it is deprecated, and you should install nvidia-container-toolkit instead. Other places say that nvidia-docker2 is required (even for docker versions 19.03+) if you plan on running Kubernetes on top of docker. While both statements are technically true, I can see why things might be a little confusing. Starting from the bottom, below...