HDInsightOnDemandLinkedService Class

public final class HDInsightOnDemandLinkedService
extends LinkedService

HDInsight ondemand linked service.

Constructor Summary

Constructor Description
HDInsightOnDemandLinkedService()

Creates an instance of HDInsightOnDemandLinkedService class.

Method Summary

Modifier and Type Method and Description
List<LinkedServiceReference> additionalLinkedServiceNames()

Get the additionalLinkedServiceNames property: Specifies additional storage accounts for the HDInsight linked service so that the Data Factory service can register them on your behalf.

Object clusterNamePrefix()

Get the clusterNamePrefix property: The prefix of cluster name, postfix will be distinct with timestamp.

SecretBase clusterPassword()

Get the clusterPassword property: The password to access the cluster.

Object clusterResourceGroup()

Get the clusterResourceGroup property: The resource group where the cluster belongs.

Object clusterSize()

Get the clusterSize property: Number of worker/data nodes in the cluster.

SecretBase clusterSshPassword()

Get the clusterSshPassword property: The password to SSH remotely connect cluster\u2019s node (for Linux).

Object clusterSshUsername()

Get the clusterSshUsername property: The username to SSH remotely connect to cluster\u2019s node (for Linux).

Object clusterType()

Get the clusterType property: The cluster type.

Object clusterUsername()

Get the clusterUsername property: The username to access the cluster.

Object coreConfiguration()

Get the coreConfiguration property: Specifies the core configuration parameters (as in core-site.xml) for the HDInsight cluster to be created.

CredentialReference credential()

Get the credential property: The credential reference containing authentication information.

Object dataNodeSize()

Get the dataNodeSize property: Specifies the size of the data node for the HDInsight cluster.

String encryptedCredential()

Get the encryptedCredential property: The encrypted credential used for authentication.

Object hBaseConfiguration()

Get the hBaseConfiguration property: Specifies the HBase configuration parameters (hbase-site.xml) for the HDInsight cluster.

LinkedServiceReference hcatalogLinkedServiceName()

Get the hcatalogLinkedServiceName property: The name of Azure SQL linked service that point to the HCatalog database.

Object hdfsConfiguration()

Get the hdfsConfiguration property: Specifies the HDFS configuration parameters (hdfs-site.xml) for the HDInsight cluster.

Object headNodeSize()

Get the headNodeSize property: Specifies the size of the head node for the HDInsight cluster.

Object hiveConfiguration()

Get the hiveConfiguration property: Specifies the hive configuration parameters (hive-site.xml) for the HDInsight cluster.

Object hostSubscriptionId()

Get the hostSubscriptionId property: The customer\u2019s subscription to host the cluster.

LinkedServiceReference linkedServiceName()

Get the linkedServiceName property: Azure Storage linked service to be used by the on-demand cluster for storing and processing data.

Object mapReduceConfiguration()

Get the mapReduceConfiguration property: Specifies the MapReduce configuration parameters (mapred-site.xml) for the HDInsight cluster.

Object oozieConfiguration()

Get the oozieConfiguration property: Specifies the Oozie configuration parameters (oozie-site.xml) for the HDInsight cluster.

List<ScriptAction> scriptActions()

Get the scriptActions property: Custom script actions to run on HDI ondemand cluster once it's up.

Object servicePrincipalId()

Get the servicePrincipalId property: The service principal id for the hostSubscriptionId.

SecretBase servicePrincipalKey()

Get the servicePrincipalKey property: The key for the service principal id.

Object sparkVersion()

Get the sparkVersion property: The version of spark if the cluster type is 'spark'.

Object stormConfiguration()

Get the stormConfiguration property: Specifies the Storm configuration parameters (storm-site.xml) for the HDInsight cluster.

Object subnetName()

Get the subnetName property: The ARM resource ID for the subnet in the vNet.

Object tenant()

Get the tenant property: The Tenant id/name to which the service principal belongs.

Object timeToLive()

Get the timeToLive property: The allowed idle time for the on-demand HDInsight cluster.

void validate()

Validates the instance.

Object version()

Get the version property: Version of the HDInsight cluster. Type: string (or Expression with resultType string).

Object virtualNetworkId()

Get the virtualNetworkId property: The ARM resource ID for the vNet to which the cluster should be joined after creation.

HDInsightOnDemandLinkedService withAdditionalLinkedServiceNames(List<LinkedServiceReference> additionalLinkedServiceNames)

Set the additionalLinkedServiceNames property: Specifies additional storage accounts for the HDInsight linked service so that the Data Factory service can register them on your behalf.

HDInsightOnDemandLinkedService withAnnotations(List<Object> annotations)

Set the annotations property: List of tags that can be used for describing the linked service.

HDInsightOnDemandLinkedService withClusterNamePrefix(Object clusterNamePrefix)

Set the clusterNamePrefix property: The prefix of cluster name, postfix will be distinct with timestamp.

HDInsightOnDemandLinkedService withClusterPassword(SecretBase clusterPassword)

Set the clusterPassword property: The password to access the cluster.

HDInsightOnDemandLinkedService withClusterResourceGroup(Object clusterResourceGroup)

Set the clusterResourceGroup property: The resource group where the cluster belongs.

HDInsightOnDemandLinkedService withClusterSize(Object clusterSize)

Set the clusterSize property: Number of worker/data nodes in the cluster.

HDInsightOnDemandLinkedService withClusterSshPassword(SecretBase clusterSshPassword)

Set the clusterSshPassword property: The password to SSH remotely connect cluster\u2019s node (for Linux).

HDInsightOnDemandLinkedService withClusterSshUsername(Object clusterSshUsername)

Set the clusterSshUsername property: The username to SSH remotely connect to cluster\u2019s node (for Linux).

HDInsightOnDemandLinkedService withClusterType(Object clusterType)

Set the clusterType property: The cluster type.

HDInsightOnDemandLinkedService withClusterUsername(Object clusterUsername)

Set the clusterUsername property: The username to access the cluster.

HDInsightOnDemandLinkedService withConnectVia(IntegrationRuntimeReference connectVia)

Set the connectVia property: The integration runtime reference.

HDInsightOnDemandLinkedService withCoreConfiguration(Object coreConfiguration)

Set the coreConfiguration property: Specifies the core configuration parameters (as in core-site.xml) for the HDInsight cluster to be created.

HDInsightOnDemandLinkedService withCredential(CredentialReference credential)

Set the credential property: The credential reference containing authentication information.

HDInsightOnDemandLinkedService withDataNodeSize(Object dataNodeSize)

Set the dataNodeSize property: Specifies the size of the data node for the HDInsight cluster.

HDInsightOnDemandLinkedService withDescription(String description)

Set the description property: Linked service description.

HDInsightOnDemandLinkedService withEncryptedCredential(String encryptedCredential)

Set the encryptedCredential property: The encrypted credential used for authentication.

HDInsightOnDemandLinkedService withHBaseConfiguration(Object hBaseConfiguration)

Set the hBaseConfiguration property: Specifies the HBase configuration parameters (hbase-site.xml) for the HDInsight cluster.

HDInsightOnDemandLinkedService withHcatalogLinkedServiceName(LinkedServiceReference hcatalogLinkedServiceName)

Set the hcatalogLinkedServiceName property: The name of Azure SQL linked service that point to the HCatalog database.

HDInsightOnDemandLinkedService withHdfsConfiguration(Object hdfsConfiguration)

Set the hdfsConfiguration property: Specifies the HDFS configuration parameters (hdfs-site.xml) for the HDInsight cluster.

HDInsightOnDemandLinkedService withHeadNodeSize(Object headNodeSize)

Set the headNodeSize property: Specifies the size of the head node for the HDInsight cluster.

HDInsightOnDemandLinkedService withHiveConfiguration(Object hiveConfiguration)

Set the hiveConfiguration property: Specifies the hive configuration parameters (hive-site.xml) for the HDInsight cluster.

HDInsightOnDemandLinkedService withHostSubscriptionId(Object hostSubscriptionId)

Set the hostSubscriptionId property: The customer\u2019s subscription to host the cluster.

HDInsightOnDemandLinkedService withLinkedServiceName(LinkedServiceReference linkedServiceName)

Set the linkedServiceName property: Azure Storage linked service to be used by the on-demand cluster for storing and processing data.

HDInsightOnDemandLinkedService withMapReduceConfiguration(Object mapReduceConfiguration)

Set the mapReduceConfiguration property: Specifies the MapReduce configuration parameters (mapred-site.xml) for the HDInsight cluster.

HDInsightOnDemandLinkedService withOozieConfiguration(Object oozieConfiguration)

Set the oozieConfiguration property: Specifies the Oozie configuration parameters (oozie-site.xml) for the HDInsight cluster.

HDInsightOnDemandLinkedService withParameters(Map<String,ParameterSpecification> parameters)

Set the parameters property: Parameters for linked service.

HDInsightOnDemandLinkedService withScriptActions(List<ScriptAction> scriptActions)

Set the scriptActions property: Custom script actions to run on HDI ondemand cluster once it's up.

HDInsightOnDemandLinkedService withServicePrincipalId(Object servicePrincipalId)

Set the servicePrincipalId property: The service principal id for the hostSubscriptionId.

HDInsightOnDemandLinkedService withServicePrincipalKey(SecretBase servicePrincipalKey)

Set the servicePrincipalKey property: The key for the service principal id.

HDInsightOnDemandLinkedService withSparkVersion(Object sparkVersion)

Set the sparkVersion property: The version of spark if the cluster type is 'spark'.

HDInsightOnDemandLinkedService withStormConfiguration(Object stormConfiguration)

Set the stormConfiguration property: Specifies the Storm configuration parameters (storm-site.xml) for the HDInsight cluster.

HDInsightOnDemandLinkedService withSubnetName(Object subnetName)

Set the subnetName property: The ARM resource ID for the subnet in the vNet.

HDInsightOnDemandLinkedService withTenant(Object tenant)

Set the tenant property: The Tenant id/name to which the service principal belongs.

HDInsightOnDemandLinkedService withTimeToLive(Object timeToLive)

Set the timeToLive property: The allowed idle time for the on-demand HDInsight cluster.

HDInsightOnDemandLinkedService withVersion(Object version)

Set the version property: Version of the HDInsight cluster. Type: string (or Expression with resultType string).

HDInsightOnDemandLinkedService withVirtualNetworkId(Object virtualNetworkId)

Set the virtualNetworkId property: The ARM resource ID for the vNet to which the cluster should be joined after creation.

HDInsightOnDemandLinkedService withYarnConfiguration(Object yarnConfiguration)

Set the yarnConfiguration property: Specifies the Yarn configuration parameters (yarn-site.xml) for the HDInsight cluster.

HDInsightOnDemandLinkedService withZookeeperNodeSize(Object zookeeperNodeSize)

Set the zookeeperNodeSize property: Specifies the size of the Zoo Keeper node for the HDInsight cluster.

Object yarnConfiguration()

Get the yarnConfiguration property: Specifies the Yarn configuration parameters (yarn-site.xml) for the HDInsight cluster.

Object zookeeperNodeSize()

Get the zookeeperNodeSize property: Specifies the size of the Zoo Keeper node for the HDInsight cluster.

Methods inherited from LinkedService

Methods inherited from java.lang.Object

Constructor Details

HDInsightOnDemandLinkedService

public HDInsightOnDemandLinkedService()

Creates an instance of HDInsightOnDemandLinkedService class.

Method Details

additionalLinkedServiceNames

public List additionalLinkedServiceNames()

Get the additionalLinkedServiceNames property: Specifies additional storage accounts for the HDInsight linked service so that the Data Factory service can register them on your behalf.

Returns:

the additionalLinkedServiceNames value.

clusterNamePrefix

public Object clusterNamePrefix()

Get the clusterNamePrefix property: The prefix of cluster name, postfix will be distinct with timestamp. Type: string (or Expression with resultType string).

Returns:

the clusterNamePrefix value.

clusterPassword

public SecretBase clusterPassword()

Get the clusterPassword property: The password to access the cluster.

Returns:

the clusterPassword value.

clusterResourceGroup

public Object clusterResourceGroup()

Get the clusterResourceGroup property: The resource group where the cluster belongs. Type: string (or Expression with resultType string).

Returns:

the clusterResourceGroup value.

clusterSize

public Object clusterSize()

Get the clusterSize property: Number of worker/data nodes in the cluster. Suggestion value: 4. Type: int (or Expression with resultType int).

Returns:

the clusterSize value.

clusterSshPassword

public SecretBase clusterSshPassword()

Get the clusterSshPassword property: The password to SSH remotely connect cluster\u2019s node (for Linux).

Returns:

the clusterSshPassword value.

clusterSshUsername

public Object clusterSshUsername()

Get the clusterSshUsername property: The username to SSH remotely connect to cluster\u2019s node (for Linux). Type: string (or Expression with resultType string).

Returns:

the clusterSshUsername value.

clusterType

public Object clusterType()

Get the clusterType property: The cluster type. Type: string (or Expression with resultType string).

Returns:

the clusterType value.

clusterUsername

public Object clusterUsername()

Get the clusterUsername property: The username to access the cluster. Type: string (or Expression with resultType string).

Returns:

the clusterUsername value.

coreConfiguration

public Object coreConfiguration()

Get the coreConfiguration property: Specifies the core configuration parameters (as in core-site.xml) for the HDInsight cluster to be created.

Returns:

the coreConfiguration value.

credential

public CredentialReference credential()

Get the credential property: The credential reference containing authentication information.

Returns:

the credential value.

dataNodeSize

public Object dataNodeSize()

Get the dataNodeSize property: Specifies the size of the data node for the HDInsight cluster.

Returns:

the dataNodeSize value.

encryptedCredential

public String encryptedCredential()

Get the encryptedCredential property: The encrypted credential used for authentication. Credentials are encrypted using the integration runtime credential manager. Type: string.

Returns:

the encryptedCredential value.

hBaseConfiguration

public Object hBaseConfiguration()

Get the hBaseConfiguration property: Specifies the HBase configuration parameters (hbase-site.xml) for the HDInsight cluster.

Returns:

the hBaseConfiguration value.

hcatalogLinkedServiceName

public LinkedServiceReference hcatalogLinkedServiceName()

Get the hcatalogLinkedServiceName property: The name of Azure SQL linked service that point to the HCatalog database. The on-demand HDInsight cluster is created by using the Azure SQL database as the metastore.

Returns:

the hcatalogLinkedServiceName value.

hdfsConfiguration

public Object hdfsConfiguration()

Get the hdfsConfiguration property: Specifies the HDFS configuration parameters (hdfs-site.xml) for the HDInsight cluster.

Returns:

the hdfsConfiguration value.

headNodeSize

public Object headNodeSize()

Get the headNodeSize property: Specifies the size of the head node for the HDInsight cluster.

Returns:

the headNodeSize value.

hiveConfiguration

public Object hiveConfiguration()

Get the hiveConfiguration property: Specifies the hive configuration parameters (hive-site.xml) for the HDInsight cluster.

Returns:

the hiveConfiguration value.

hostSubscriptionId

public Object hostSubscriptionId()

Get the hostSubscriptionId property: The customer\u2019s subscription to host the cluster. Type: string (or Expression with resultType string).

Returns:

the hostSubscriptionId value.

linkedServiceName

public LinkedServiceReference linkedServiceName()

Get the linkedServiceName property: Azure Storage linked service to be used by the on-demand cluster for storing and processing data.

Returns:

the linkedServiceName value.

mapReduceConfiguration

public Object mapReduceConfiguration()

Get the mapReduceConfiguration property: Specifies the MapReduce configuration parameters (mapred-site.xml) for the HDInsight cluster.

Returns:

the mapReduceConfiguration value.

oozieConfiguration

public Object oozieConfiguration()

Get the oozieConfiguration property: Specifies the Oozie configuration parameters (oozie-site.xml) for the HDInsight cluster.

Returns:

the oozieConfiguration value.

scriptActions

public List scriptActions()

Get the scriptActions property: Custom script actions to run on HDI ondemand cluster once it's up. Please refer to https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster-linux?toc=%2Fen-us%2Fazure%2Fhdinsight%2Fr-server%2FTOC.json&bc=%2Fen-us%2Fazure%2Fbread%2Ftoc.json\#understanding-script-actions.

Returns:

the scriptActions value.

servicePrincipalId

public Object servicePrincipalId()

Get the servicePrincipalId property: The service principal id for the hostSubscriptionId. Type: string (or Expression with resultType string).

Returns:

the servicePrincipalId value.

servicePrincipalKey

public SecretBase servicePrincipalKey()

Get the servicePrincipalKey property: The key for the service principal id.

Returns:

the servicePrincipalKey value.

sparkVersion

public Object sparkVersion()

Get the sparkVersion property: The version of spark if the cluster type is 'spark'. Type: string (or Expression with resultType string).

Returns:

the sparkVersion value.

stormConfiguration

public Object stormConfiguration()

Get the stormConfiguration property: Specifies the Storm configuration parameters (storm-site.xml) for the HDInsight cluster.

Returns:

the stormConfiguration value.

subnetName

public Object subnetName()

Get the subnetName property: The ARM resource ID for the subnet in the vNet. If virtualNetworkId was specified, then this property is required. Type: string (or Expression with resultType string).

Returns:

the subnetName value.

tenant

public Object tenant()

Get the tenant property: The Tenant id/name to which the service principal belongs. Type: string (or Expression with resultType string).

Returns:

the tenant value.

timeToLive

public Object timeToLive()

Get the timeToLive property: The allowed idle time for the on-demand HDInsight cluster. Specifies how long the on-demand HDInsight cluster stays alive after completion of an activity run if there are no other active jobs in the cluster. The minimum value is 5 mins. Type: string (or Expression with resultType string).

Returns:

the timeToLive value.

validate

public void validate()

Validates the instance.

Overrides:

HDInsightOnDemandLinkedService.validate()

version

public Object version()

Get the version property: Version of the HDInsight cluster. Type: string (or Expression with resultType string).

Returns:

the version value.

virtualNetworkId

public Object virtualNetworkId()

Get the virtualNetworkId property: The ARM resource ID for the vNet to which the cluster should be joined after creation. Type: string (or Expression with resultType string).

Returns:

the virtualNetworkId value.

withAdditionalLinkedServiceNames

public HDInsightOnDemandLinkedService withAdditionalLinkedServiceNames(List additionalLinkedServiceNames)

Set the additionalLinkedServiceNames property: Specifies additional storage accounts for the HDInsight linked service so that the Data Factory service can register them on your behalf.

Parameters:

additionalLinkedServiceNames - the additionalLinkedServiceNames value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withAnnotations

public HDInsightOnDemandLinkedService withAnnotations(List annotations)

Set the annotations property: List of tags that can be used for describing the linked service.

Overrides:

HDInsightOnDemandLinkedService.withAnnotations(List<Object> annotations)

Parameters:

annotations

withClusterNamePrefix

public HDInsightOnDemandLinkedService withClusterNamePrefix(Object clusterNamePrefix)

Set the clusterNamePrefix property: The prefix of cluster name, postfix will be distinct with timestamp. Type: string (or Expression with resultType string).

Parameters:

clusterNamePrefix - the clusterNamePrefix value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withClusterPassword

public HDInsightOnDemandLinkedService withClusterPassword(SecretBase clusterPassword)

Set the clusterPassword property: The password to access the cluster.

Parameters:

clusterPassword - the clusterPassword value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withClusterResourceGroup

public HDInsightOnDemandLinkedService withClusterResourceGroup(Object clusterResourceGroup)

Set the clusterResourceGroup property: The resource group where the cluster belongs. Type: string (or Expression with resultType string).

Parameters:

clusterResourceGroup - the clusterResourceGroup value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withClusterSize

public HDInsightOnDemandLinkedService withClusterSize(Object clusterSize)

Set the clusterSize property: Number of worker/data nodes in the cluster. Suggestion value: 4. Type: int (or Expression with resultType int).

Parameters:

clusterSize - the clusterSize value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withClusterSshPassword

public HDInsightOnDemandLinkedService withClusterSshPassword(SecretBase clusterSshPassword)

Set the clusterSshPassword property: The password to SSH remotely connect cluster\u2019s node (for Linux).

Parameters:

clusterSshPassword - the clusterSshPassword value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withClusterSshUsername

public HDInsightOnDemandLinkedService withClusterSshUsername(Object clusterSshUsername)

Set the clusterSshUsername property: The username to SSH remotely connect to cluster\u2019s node (for Linux). Type: string (or Expression with resultType string).

Parameters:

clusterSshUsername - the clusterSshUsername value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withClusterType

public HDInsightOnDemandLinkedService withClusterType(Object clusterType)

Set the clusterType property: The cluster type. Type: string (or Expression with resultType string).

Parameters:

clusterType - the clusterType value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withClusterUsername

public HDInsightOnDemandLinkedService withClusterUsername(Object clusterUsername)

Set the clusterUsername property: The username to access the cluster. Type: string (or Expression with resultType string).

Parameters:

clusterUsername - the clusterUsername value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withConnectVia

public HDInsightOnDemandLinkedService withConnectVia(IntegrationRuntimeReference connectVia)

Set the connectVia property: The integration runtime reference.

Overrides:

HDInsightOnDemandLinkedService.withConnectVia(IntegrationRuntimeReference connectVia)

Parameters:

connectVia

withCoreConfiguration

public HDInsightOnDemandLinkedService withCoreConfiguration(Object coreConfiguration)

Set the coreConfiguration property: Specifies the core configuration parameters (as in core-site.xml) for the HDInsight cluster to be created.

Parameters:

coreConfiguration - the coreConfiguration value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withCredential

public HDInsightOnDemandLinkedService withCredential(CredentialReference credential)

Set the credential property: The credential reference containing authentication information.

Parameters:

credential - the credential value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withDataNodeSize

public HDInsightOnDemandLinkedService withDataNodeSize(Object dataNodeSize)

Set the dataNodeSize property: Specifies the size of the data node for the HDInsight cluster.

Parameters:

dataNodeSize - the dataNodeSize value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withDescription

public HDInsightOnDemandLinkedService withDescription(String description)

Set the description property: Linked service description.

Overrides:

HDInsightOnDemandLinkedService.withDescription(String description)

Parameters:

description

withEncryptedCredential

public HDInsightOnDemandLinkedService withEncryptedCredential(String encryptedCredential)

Set the encryptedCredential property: The encrypted credential used for authentication. Credentials are encrypted using the integration runtime credential manager. Type: string.

Parameters:

encryptedCredential - the encryptedCredential value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withHBaseConfiguration

public HDInsightOnDemandLinkedService withHBaseConfiguration(Object hBaseConfiguration)

Set the hBaseConfiguration property: Specifies the HBase configuration parameters (hbase-site.xml) for the HDInsight cluster.

Parameters:

hBaseConfiguration - the hBaseConfiguration value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withHcatalogLinkedServiceName

public HDInsightOnDemandLinkedService withHcatalogLinkedServiceName(LinkedServiceReference hcatalogLinkedServiceName)

Set the hcatalogLinkedServiceName property: The name of Azure SQL linked service that point to the HCatalog database. The on-demand HDInsight cluster is created by using the Azure SQL database as the metastore.

Parameters:

hcatalogLinkedServiceName - the hcatalogLinkedServiceName value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withHdfsConfiguration

public HDInsightOnDemandLinkedService withHdfsConfiguration(Object hdfsConfiguration)

Set the hdfsConfiguration property: Specifies the HDFS configuration parameters (hdfs-site.xml) for the HDInsight cluster.

Parameters:

hdfsConfiguration - the hdfsConfiguration value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withHeadNodeSize

public HDInsightOnDemandLinkedService withHeadNodeSize(Object headNodeSize)

Set the headNodeSize property: Specifies the size of the head node for the HDInsight cluster.

Parameters:

headNodeSize - the headNodeSize value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withHiveConfiguration

public HDInsightOnDemandLinkedService withHiveConfiguration(Object hiveConfiguration)

Set the hiveConfiguration property: Specifies the hive configuration parameters (hive-site.xml) for the HDInsight cluster.

Parameters:

hiveConfiguration - the hiveConfiguration value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withHostSubscriptionId

public HDInsightOnDemandLinkedService withHostSubscriptionId(Object hostSubscriptionId)

Set the hostSubscriptionId property: The customer\u2019s subscription to host the cluster. Type: string (or Expression with resultType string).

Parameters:

hostSubscriptionId - the hostSubscriptionId value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withLinkedServiceName

public HDInsightOnDemandLinkedService withLinkedServiceName(LinkedServiceReference linkedServiceName)

Set the linkedServiceName property: Azure Storage linked service to be used by the on-demand cluster for storing and processing data.

Parameters:

linkedServiceName - the linkedServiceName value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withMapReduceConfiguration

public HDInsightOnDemandLinkedService withMapReduceConfiguration(Object mapReduceConfiguration)

Set the mapReduceConfiguration property: Specifies the MapReduce configuration parameters (mapred-site.xml) for the HDInsight cluster.

Parameters:

mapReduceConfiguration - the mapReduceConfiguration value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withOozieConfiguration

public HDInsightOnDemandLinkedService withOozieConfiguration(Object oozieConfiguration)

Set the oozieConfiguration property: Specifies the Oozie configuration parameters (oozie-site.xml) for the HDInsight cluster.

Parameters:

oozieConfiguration - the oozieConfiguration value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withParameters

public HDInsightOnDemandLinkedService withParameters(Map parameters)

Set the parameters property: Parameters for linked service.

Overrides:

HDInsightOnDemandLinkedService.withParameters(Map<String,ParameterSpecification> parameters)

Parameters:

parameters

withScriptActions

public HDInsightOnDemandLinkedService withScriptActions(List scriptActions)

Set the scriptActions property: Custom script actions to run on HDI ondemand cluster once it's up. Please refer to https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster-linux?toc=%2Fen-us%2Fazure%2Fhdinsight%2Fr-server%2FTOC.json&bc=%2Fen-us%2Fazure%2Fbread%2Ftoc.json\#understanding-script-actions.

Parameters:

scriptActions - the scriptActions value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withServicePrincipalId

public HDInsightOnDemandLinkedService withServicePrincipalId(Object servicePrincipalId)

Set the servicePrincipalId property: The service principal id for the hostSubscriptionId. Type: string (or Expression with resultType string).

Parameters:

servicePrincipalId - the servicePrincipalId value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withServicePrincipalKey

public HDInsightOnDemandLinkedService withServicePrincipalKey(SecretBase servicePrincipalKey)

Set the servicePrincipalKey property: The key for the service principal id.

Parameters:

servicePrincipalKey - the servicePrincipalKey value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withSparkVersion

public HDInsightOnDemandLinkedService withSparkVersion(Object sparkVersion)

Set the sparkVersion property: The version of spark if the cluster type is 'spark'. Type: string (or Expression with resultType string).

Parameters:

sparkVersion - the sparkVersion value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withStormConfiguration

public HDInsightOnDemandLinkedService withStormConfiguration(Object stormConfiguration)

Set the stormConfiguration property: Specifies the Storm configuration parameters (storm-site.xml) for the HDInsight cluster.

Parameters:

stormConfiguration - the stormConfiguration value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withSubnetName

public HDInsightOnDemandLinkedService withSubnetName(Object subnetName)

Set the subnetName property: The ARM resource ID for the subnet in the vNet. If virtualNetworkId was specified, then this property is required. Type: string (or Expression with resultType string).

Parameters:

subnetName - the subnetName value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withTenant

public HDInsightOnDemandLinkedService withTenant(Object tenant)

Set the tenant property: The Tenant id/name to which the service principal belongs. Type: string (or Expression with resultType string).

Parameters:

tenant - the tenant value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withTimeToLive

public HDInsightOnDemandLinkedService withTimeToLive(Object timeToLive)

Set the timeToLive property: The allowed idle time for the on-demand HDInsight cluster. Specifies how long the on-demand HDInsight cluster stays alive after completion of an activity run if there are no other active jobs in the cluster. The minimum value is 5 mins. Type: string (or Expression with resultType string).

Parameters:

timeToLive - the timeToLive value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withVersion

public HDInsightOnDemandLinkedService withVersion(Object version)

Set the version property: Version of the HDInsight cluster. Type: string (or Expression with resultType string).

Parameters:

version - the version value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withVirtualNetworkId

public HDInsightOnDemandLinkedService withVirtualNetworkId(Object virtualNetworkId)

Set the virtualNetworkId property: The ARM resource ID for the vNet to which the cluster should be joined after creation. Type: string (or Expression with resultType string).

Parameters:

virtualNetworkId - the virtualNetworkId value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withYarnConfiguration

public HDInsightOnDemandLinkedService withYarnConfiguration(Object yarnConfiguration)

Set the yarnConfiguration property: Specifies the Yarn configuration parameters (yarn-site.xml) for the HDInsight cluster.

Parameters:

yarnConfiguration - the yarnConfiguration value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

withZookeeperNodeSize

public HDInsightOnDemandLinkedService withZookeeperNodeSize(Object zookeeperNodeSize)

Set the zookeeperNodeSize property: Specifies the size of the Zoo Keeper node for the HDInsight cluster.

Parameters:

zookeeperNodeSize - the zookeeperNodeSize value to set.

Returns:

the HDInsightOnDemandLinkedService object itself.

yarnConfiguration

public Object yarnConfiguration()

Get the yarnConfiguration property: Specifies the Yarn configuration parameters (yarn-site.xml) for the HDInsight cluster.

Returns:

the yarnConfiguration value.

zookeeperNodeSize

public Object zookeeperNodeSize()

Get the zookeeperNodeSize property: Specifies the size of the Zoo Keeper node for the HDInsight cluster.

Returns:

the zookeeperNodeSize value.

Applies to