HDInsightOnDemandLinkedService Class
HDInsight ondemand linked service.
All required parameters must be populated in order to send to Azure.
- Inheritance
-
azure.mgmt.datafactory.models._models_py3.LinkedServiceHDInsightOnDemandLinkedService
Constructor
HDInsightOnDemandLinkedService(*, cluster_size: Any, time_to_live: Any, version: Any, linked_service_name: _models.LinkedServiceReference, host_subscription_id: Any, tenant: Any, cluster_resource_group: Any, additional_properties: Optional[Dict[str, Any]] = None, connect_via: Optional[_models.IntegrationRuntimeReference] = None, description: Optional[str] = None, parameters: Optional[Dict[str, _models.ParameterSpecification]] = None, annotations: Optional[List[Any]] = None, service_principal_id: Optional[Any] = None, service_principal_key: Optional[_models.SecretBase] = None, cluster_name_prefix: Optional[Any] = None, cluster_user_name: Optional[Any] = None, cluster_password: Optional[_models.SecretBase] = None, cluster_ssh_user_name: Optional[Any] = None, cluster_ssh_password: Optional[_models.SecretBase] = None, additional_linked_service_names: Optional[List[_models.LinkedServiceReference]] = None, hcatalog_linked_service_name: Optional[_models.LinkedServiceReference] = None, cluster_type: Optional[Any] = None, spark_version: Optional[Any] = None, core_configuration: Optional[Any] = None, h_base_configuration: Optional[Any] = None, hdfs_configuration: Optional[Any] = None, hive_configuration: Optional[Any] = None, map_reduce_configuration: Optional[Any] = None, oozie_configuration: Optional[Any] = None, storm_configuration: Optional[Any] = None, yarn_configuration: Optional[Any] = None, encrypted_credential: Optional[Any] = None, head_node_size: Optional[Any] = None, data_node_size: Optional[Any] = None, zookeeper_node_size: Optional[Any] = None, script_actions: Optional[List[_models.ScriptAction]] = None, virtual_network_id: Optional[Any] = None, subnet_name: Optional[Any] = None, credential: Optional[_models.CredentialReference] = None, **kwargs)Variables
Unmatched properties from the message are deserialized to this collection.
- type
- str
Required. Type of linked service.Constant filled by server.
- connect_via
- IntegrationRuntimeReference
The integration runtime reference.
- description
- str
Linked service description.
- parameters
- dict[str, ParameterSpecification]
Parameters for linked service.
- cluster_size
- any
Required. Number of worker/data nodes in the cluster. Suggestion value: 4. Type: string (or Expression with resultType string).
- time_to_live
- any
Required. The allowed idle time for the on-demand HDInsight cluster. Specifies how long the on-demand HDInsight cluster stays alive after completion of an activity run if there are no other active jobs in the cluster. The minimum value is 5 mins. Type: string (or Expression with resultType string).
- version
- any
Required. Version of the HDInsight cluster. Type: string (or Expression with resultType string).
- linked_service_name
- LinkedServiceReference
Required. Azure Storage linked service to be used by the on-demand cluster for storing and processing data.
- host_subscription_id
- any
Required. The customer's subscription to host the cluster. Type: string (or Expression with resultType string).
- service_principal_id
- any
The service principal id for the hostSubscriptionId. Type: string (or Expression with resultType string).
- service_principal_key
- SecretBase
The key for the service principal id.
- tenant
- any
Required. The Tenant id/name to which the service principal belongs. Type: string (or Expression with resultType string).
- cluster_resource_group
- any
Required. The resource group where the cluster belongs. Type: string (or Expression with resultType string).
- cluster_name_prefix
- any
The prefix of cluster name, postfix will be distinct with timestamp. Type: string (or Expression with resultType string).
- cluster_user_name
- any
The username to access the cluster. Type: string (or Expression with resultType string).
- cluster_password
- SecretBase
The password to access the cluster.
- cluster_ssh_user_name
- any
The username to SSH remotely connect to cluster's node (for Linux). Type: string (or Expression with resultType string).
- cluster_ssh_password
- SecretBase
The password to SSH remotely connect cluster's node (for Linux).
- additional_linked_service_names
- list[LinkedServiceReference]
Specifies additional storage accounts for the HDInsight linked service so that the Data Factory service can register them on your behalf.
- hcatalog_linked_service_name
- LinkedServiceReference
The name of Azure SQL linked service that point to the HCatalog database. The on-demand HDInsight cluster is created by using the Azure SQL database as the metastore.
- cluster_type
- any
The cluster type. Type: string (or Expression with resultType string).
- spark_version
- any
The version of spark if the cluster type is 'spark'. Type: string (or Expression with resultType string).
- core_configuration
- any
Specifies the core configuration parameters (as in core-site.xml) for the HDInsight cluster to be created.
- h_base_configuration
- any
Specifies the HBase configuration parameters (hbase-site.xml) for the HDInsight cluster.
- hdfs_configuration
- any
Specifies the HDFS configuration parameters (hdfs-site.xml) for the HDInsight cluster.
- hive_configuration
- any
Specifies the hive configuration parameters (hive-site.xml) for the HDInsight cluster.
- map_reduce_configuration
- any
Specifies the MapReduce configuration parameters (mapred-site.xml) for the HDInsight cluster.
- oozie_configuration
- any
Specifies the Oozie configuration parameters (oozie-site.xml) for the HDInsight cluster.
- storm_configuration
- any
Specifies the Storm configuration parameters (storm-site.xml) for the HDInsight cluster.
- yarn_configuration
- any
Specifies the Yarn configuration parameters (yarn-site.xml) for the HDInsight cluster.
- encrypted_credential
- any
The encrypted credential used for authentication. Credentials are encrypted using the integration runtime credential manager. Type: string (or Expression with resultType string).
- head_node_size
- any
Specifies the size of the head node for the HDInsight cluster.
- data_node_size
- any
Specifies the size of the data node for the HDInsight cluster.
- zookeeper_node_size
- any
Specifies the size of the Zoo Keeper node for the HDInsight cluster.
- script_actions
- list[ScriptAction]
Custom script actions to run on HDI ondemand cluster once it's up. Please refer to https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster-linux?toc=%2Fen-us%2Fazure%2Fhdinsight%2Fr-server%2FTOC.json&bc=%2Fen-us%2Fazure%2Fbread%2Ftoc.json#understanding-script-actions.
- virtual_network_id
- any
The ARM resource ID for the vNet to which the cluster should be joined after creation. Type: string (or Expression with resultType string).
- subnet_name
- any
The ARM resource ID for the subnet in the vNet. If virtualNetworkId was specified, then this property is required. Type: string (or Expression with resultType string).
- credential
- CredentialReference
The credential reference containing authentication information.
Feedback
Submit and view feedback for