Docker image building for GPU workload on AKS cluster

Question

Hello, I've had some trouble building an image that can utilize the GPU on the AKS cluster. The instructions shown on this article were followed to install the Nvidia plugin. My understanding is that the image needs to contain the Nvidia drivers, therefore I've used the nvidia/cuda as the base image and tried to install specifically python 3.7.6 on it. However, the final image always ends up with python version 3.6.9.

Also, which cuda version should I install?

I would appreciate any suggestions on how that can be done properly.

Moreover, I'd like to know how to specify the Nvidia library locations in the Kubernetes manifest, as mentioned in this article.

Thanks!

Answer 1

Update:

I've managed to make it work by using this Nvidia base image. Thereafter, installed python dependencies and updated the default python interpreter to be the version that I need. Also, the python-cffi package needs to be installed. Hope this helps anyone trying to do the same!