question

JosselinGuillozet-4719 avatar image
0 Votes"
JosselinGuillozet-4719 asked LucaBrighetti-0792 commented

How to disable accelerated network on cluster nodearray which seems to conflict with InfiniBand?

I have been running HPC cluster with HB-series VMs in West Europe for a few months without issue.

Recently, I have had trouble with the Mellanox InfiniBand driver.
It seems to be due to the Accelerated Networking option enabled for the nodeararrays (VM scale set) created by CycleCloud.

I would like to be able to disable this Accelerated Network from the CycleCloud template.

azure-cyclecloud
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PaulEdwards-0991 avatar image
1 Vote"
PaulEdwards-0991 answered LucaBrighetti-0792 commented

To disable accelerated networking in the UI:

  • Select the "Arrays" tab

  • Select the row and click "Edit"

  • Click the "+" at the bottom of the dialog box

  • Type in "EnabledAcceleratedNetworking" and "false" in to the new line that appears and save

New nodes will now get this setting.



· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

It looks like the right command is

EnableAcceleratedNetworking and not EnabledAcceleratedNetworking

L.

0 Votes 0 ·
TravisCragg-MSFT avatar image
0 Votes"
TravisCragg-MSFT answered JosselinGuillozet-4719 commented

I do not believe that this is directly possible. Accelerated Networking is enabled / disabled via the NIC. CycleCloud's Templates do not have an option for enabling / disabling accelerated Netoworking on a NIC, but they do allow specifying an existing NIC. You can use this to specify an existing NIC that has accelerated networking disabled.


· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks for your quick reply.

However, it seems I can only specify an existing NIC for a node and not for a nodearray.
From CycleCloud documentation:

NetworkInterfaceId String Specify an existing NIC by resource ID (node only)

0 Votes 0 ·