Set up GPU drivers for N-series VMs running Windows Server
To take advantage of the GPU capabilities of Azure N-series VMs running Windows Server 2016 or Windows Server 2012 R2, install supported NVIDIA graphics drivers. This article provides driver setup steps after you deploy an N-series VM. Driver setup information is also available for Linux VMs.
For basic specs, storage capacities, and disk details, see GPU Windows VM sizes.
Supported operating systems and drivers
NV instances - NVIDIA GRID drivers
|Windows Server 2016||370.12 (.exe)|
|Windows Server 2012 R2||370.12 (.exe)|
NC instances - NVIDIA Tesla drivers
|Windows Server 2016||376.84 (.exe)|
|Windows Server 2012 R2||376.84 (.exe)|
Tesla driver download links are current at time of publication. For the latest drivers, visit the NVIDIA website.
Connect by Remote Desktop to each N-series VM.
Download, extract, and install the supported driver for your Windows operating system.
On Azure NV VMs, a restart is required after driver installation. On NC VMs, a restart is not required.
Verify driver installation
You can verify driver installation in Device Manager. The following example shows successful configuration of the Tesla K80 card on an Azure NC VM.
To query the GPU device state, run the nvidia-smi command-line utility installed with the driver.
Open a command prompt and change to the C:\Program Files\NVIDIA Corporation\NVSMI directory.
Run nvidia-smi. If the driver is installed you will see output similar to below. Note that GPU-Util shows 0% unless you are currently running a GPU workload on the VM.
RDMA network for NC24r VMs
RDMA network connectivity can be enabled on NC24r VMs deployed in the same availability set. The HpcVmDrivers extension must be added to install Windows network device drivers that enable RDMA connectivity. To add the VM extension to an NC24r VM, use Azure PowerShell cmdlets for Azure Resource Manager.
Currently, only Windows Server 2012 R2 supports the RDMA network on NC24r VMs.
To install the latest version 1.1 HpcVMDrivers extension on an existing RDMA-capable VM named myVM in the West US region:
Set-AzureRmVMExtension -ResourceGroupName "myResourceGroup" -Location "westus" -VMName "myVM" -ExtensionName "HpcVmDrivers" -Publisher "Microsoft.HpcCompute" -Type "HpcVmDrivers" -TypeHandlerVersion "1.1"
For more information, see Virtual machine extensions and features for Windows.
The RDMA network supports Message Passing Interface (MPI) traffic for applications running with Microsoft MPI or Intel MPI 5.x.
For more information about the NVIDIA GPUs on the N-series VMs, see:
Developers building GPU-accelerated applications for the NVIDIA Tesla GPUs can also download and install the CUDA Toolkit 8 for Windows Server 2016 or Windows Server 2012 R2. For more information, see the CUDA Installation Guide.