question

JordanCrockettTEKsystemsInc-7740 avatar image
0 Votes"
JordanCrockettTEKsystemsInc-7740 asked prmanhas-MSFT commented

Nvidia GPU Driver Extension for Azure Rebooting During Provisioning

I have a scale set that is connected to Azure Dev Ops. I have a customscript extension that runs a script after initial deployment to setup our test agent hosts, and the Nvidia driver extension. No matter what order the two extensions are in, the PC always reboots during provisioning due to the Nvidia driver install.

Does anyone know of a way to avoid this or prevent the Nvidia driver from installing for a time? Thank you.

azure-virtual-machines-extension
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@JordanCrockettTEKsystemsInc-7740 Any update on the issue?

Please "Accept as Answer" if below helped so it can help others in community looking for help on similar topics.

Thanks

0 Votes 0 ·
prmanhas-MSFT avatar image
1 Vote"
prmanhas-MSFT answered

@JordanCrockettTEKsystemsInc-7740 Apologies for the delay in response and all the inconvenience caused because of the issue.

Depending on the VM family, the extension installs CUDA or GRID drivers. When you install NVIDIA drivers using this extension, you are accepting and agreeing to the terms of the NVIDIA End-User License Agreement. During the installation process, the VM may reboot to complete the driver setup and that might be the reason you are seeing the behaviour.

I did some research and found below blog which might be useful in your use case :

https://michaelcollier.wordpress.com/2017/08/04/how-to-setup-nvidia-driver-on-nv-series-azure-vm/

Hope it helps!!!

Please "Accept as Answer" if it helped so it can help others in community looking for help on similar topics.

Disclaimer: This response contains a reference to a third-party World Wide Web site. Microsoft is providing this information as convenient to you. Microsoft does not control these sites and has not tested any software or information found on these sites; therefore, Microsoft cannot make any representations regarding the quality, safety, or suitability of any software or information found there.
There are inherent dangers in the use of any software found on the Internet, and Microsoft cautions you to make sure that you completely understand the risk before retrieving any software from the Internet.





5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

JordanCrockettTEKsystemsInc-7740 avatar image
0 Votes"
JordanCrockettTEKsystemsInc-7740 answered prmanhas-MSFT commented

I ended up having to use -ProvisionAfterExtension to get the Nvidia driver extension to install after my customScript extension. Also, I had to manually generate the Add-AzVmssExtension command from an example Set-AzVmExtensin given here: https://docs.microsoft.com/en-us/azure/virtual-machines/extensions/hpccompute-gpu-windows#:~:text=NVIDIA%20GPU%20Driver%20Extension%20for%20Windows%201%20Overview.,4%20Deployment.%20...%205%20Troubleshoot%20and%20support.%20.

Problem is solved now.

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@JordanCrockettTEKsystemsInc-7740 Thank you for sharing out the info!!!

Please "Accept as Answer" if any of the above response or your answer so it can help others in community looking for help on similar topics.

Thanks

0 Votes 0 ·