Azure HDInsight Create Cluster Task

APPLIES TO: yesSQL Server, including on Linux yesAzure SQL Database yesAzure SQL Data Warehouse noParallel Data Warehouse

The Azure HDInsight Create Cluster Task enables an SSIS package to create an Azure HDInsight cluster in the specified Azure subscription and resource group.

The Azure HDInsight Create Cluster Task is a component of the SQL Server Integration Services (SSIS) Feature Pack for Azure.

Note

  • Creating a new HDInsight cluster may take 10~20 minutes.
  • There is a cost associated with creating and running an Azure HDInsight cluster. See HDInsight Pricing for details.

To add an Azure HDInsight Create Cluster Task, drag-drop it to the SSIS Designer, and double-click or right-click and click Edit to see the following Azure HDInsight Create Cluster Task Editor dialog box.

The following table provides a description of the fields in this dialog box.

Field Description
AzureResourceManagerConnection Select an existing Azure Resource Manager Connection Manager or create a new one that will be used to create the HDInsight cluster.
AzureStorageConnection Select an existing Azure Storage Connection Manager or create a new one that refers to an Azure Storage Account that will be associated with the HDInsight cluster.
SubscriptionId Specify the ID of the subscription the HDInsight cluster will be created in.
ResourceGroup Specify the Azure resource group the HDInsight cluster will be created in.
Location Specify the location of the HDInsight cluster. The cluster must be created in the same location as the Azure Storage Account specified.
ClusterName Specify a name for the HDInsight cluster to be created.
ClusterSize Specify the number of nodes to create in the cluster.
BlobContainer Specify the name of the default storage container to be associated with the HDInsight cluster.
UserName Specify the user name to be used for connecting to the HDInsight cluster.
Password Specify the password to be used for connecting to the HDInsight cluster.
SshUserName Specify the user name used to remotely access the HDInsight cluster using SSH.
SshPassword Specify the password used to remotely access the HDInsight cluster using SSH.
FailIfExists Specify whether the task should fail if the cluster already exists.

Note

The locations of the HDInsight cluster and the Azure Storage Account must be the same.