HDInsight is spanned over availability zoned in region?

Question

Hi

I wonder how HDInsight fault tolerance is working.
There are availability zones in each region, so I believe HDInsight's head nodes and worker nodes are spanned over these availability zones, but it's true?

No matter how hard the failover works, if the head nodes are located in the same availability zone and system failure happened in the zone, all the head nodes will not be working.
I am worried about the same situation as worker nodes.

Please, give me some answer.
Thanks.

Answer 1

Hello @yu ,

Thanks for the question and using MS Q&A platform.

In order to provide you with optimal levels of availability for your analytics components, HDInsight was developed with a unique architecture for ensuring high availability (HA) of critical services. Some components of this architecture were developed by Microsoft to provide automatic failover. Other components are standard Apache components that are deployed to support specific services.

This infrastructure consists of a number of services and software components, some of which are designed by Microsoft. The following components are unique to the HDInsight platform:

• Slave failover controller
• Master failover controller
• Slave high availability service
• Master high availability service

This article explains the architecture of the HA service model in HDInsight, how HDInsight supports failover for HA services, and best practices to recover from other service interruptions.

Hope this helps. Do let us know if you any further queries.

------------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.