Unable to join second node on Windows 2019 failover cluster

Varun Khanna 1 Reputation point
2021-03-03T19:48:32.203+00:00

hI,

I’m in the process of creating two node Windows 2019 cluster. These are Azure Windows VMs. While creating windows failover cluster, node1 is not able to validate node2, and throws following error “The node cannot be contacted. Ensure that the node is powered on and is connected to the network.“

Both the nodes are in same VNet. Subnet is same, and same IP range and DNS servers are same as well. Test-netconnection between the ports works fine. We’ve disabled Windows firewall, and opened up tcp/ udp communication on all ports temporarily in NSG too.

The local node gets added to cluster just fine. The issue is only with adding remote 2nd node.

There’s no error found in event viewer logs (system/ application/ failover clustering). Cluster log on node1 has no error as well.

On running Add-ClusterNode powershell on node2, it throws following error:

Add-ClusterNode : Check the spelling of the cluster name. Otherwise, there might be a problem with your network. Make sure the cluster nodes are turned on and connected
to the network or contact your network administrator.
The RPC server is unavailable
At line:1 char:28

  • ... me testCL | Add-ClusterNode -Name azavsprdsqlb502.poe.gbl.msidentity. ...
  • ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  • CategoryInfo : ConnectionError: (:) [Add-ClusterNode], ClusterCmdletException
  • FullyQualifiedErrorId : ClusterRpcConnection,Microsoft.FailoverClusters.PowerShell.AddClusterNodeCommand

Has anyone encountered this issue? Any suggestion how to proceed on this.

Thanks

Varun

Windows Server 2019
Windows Server 2019
A Microsoft server operating system that supports enterprise-level management updated to data storage.
3,470 questions
Windows Server Clustering
Windows Server Clustering
Windows Server: A family of Microsoft server operating systems that support enterprise-level management, data storage, applications, and communications.Clustering: The grouping of multiple servers in a way that allows them to appear to be a single unit to client computers on a network. Clustering is a means of increasing network capacity, providing live backup in case one of the servers fails, and improving data security.
959 questions

6 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Alex Bykovskyi 1,831 Reputation points
    2021-03-03T21:53:32.24+00:00

    Hey,

    Did you try checking forward and revers dns resolution for the nodes? Did you try creating a cluster from the second node? The following guide might help:
    https://www.starwindsoftware.com/resource-library/installing-and-configuring-a-sql-server-failover-clustered-instance-on-microsoft-azure-virtual-machines/

    Cheers,

    Alex Bykovskyi

    StarWind Software

    Note: Posts are provided “AS IS” without warranty of any kind, either expressed or implied, including but not limited to the implied warranties of merchantability and/or fitness for a particular purpose.

    0 comments
  2. Varun Khanna 1 Reputation point
    2021-03-04T05:07:24.69+00:00

    Hi, I did perform forward and reverse dns look by running powershell on these nodes, and results look fine.

    $ipaddr=[System.Net.Dns]::GetHostAddresses($obj.ComputerName) | ?{$.AddressFamily -eq "InterNetwork"} | %{$.IPAddressToString}
    Write-host "IP:" $ipaddr
    $hostname=[System.Net.Dns]::GetHostByAddress($ipaddr).HostName
    Write-host "Host:" $hostname

    Yes, the issue is consistent in both the nodes. Infact, we have procured 10+ nodes, and all of them have the same issue.

    In the same IP range, VNet, subnet, DNS - we have Win 2016 OS VMs too (set-up last year), and they are running perfectly fine.

    0 comments
  3. Xiaowei He 9,871 Reputation points
    2021-03-04T05:55:17.333+00:00

    Hi,

    Do the VMs join the same domain, and the DNS configured is the DC's IP address?

    Please check if the VMs can ping with each other?

    Besides, please check if we installed failover cluster feature on each cluster nodes correctly?

    Thanks for your time!
    Best Regards,
    Anne

    If the Answer is helpful, please click "Accept Answer" and upvote it.
    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    0 comments
  4. Varun Khanna 1 Reputation point
    2021-03-06T10:40:04.007+00:00

    Thanks, opening ICMP inbound/ outbound completely in NSG solved the issue. Seems like change in rules in windows 2019, since existing rules worked well with windows 2016. Do we know specifically which ICMP ports are to be open? Thanks.

    0 comments
  5. Xiaowei He 9,871 Reputation points
    2021-03-08T01:55:18.813+00:00

    Hi,

    The port requirement for Server 2019 cluster is below:

    75100-image.png

    [https://learn.microsoft.com/en-us/troubleshoot/windows-server/networking/service-overview-and-network-port-requirements][2]
    Thanks for your time!
    Best Regards,
    Anne

    -----------------------------

    If the Answer is helpful, please click "Accept Answer" and upvote it.
    Note: Please follow the steps in our [documentation][20] to enable e-mail notifications if you want to receive the related email notification for this thread.
    [20]: https://learn.microsoft.com/en-us/answers/articles/67444/email-notifications.html [2]: https://learn.microsoft.com/en-us/troubleshoot/windows-server/networking/service-overview-and-network-port-requirements