AzureDatabricksLinkedService Class

Azure Databricks linked service.

All required parameters must be populated in order to send to Azure.

Inheritance
azure.synapse.artifacts.models._models_py3.LinkedService
AzureDatabricksLinkedService

Constructor

AzureDatabricksLinkedService(*, domain: object, access_token: SecretBase, additional_properties: Dict[str, object] | None = None, connect_via: IntegrationRuntimeReference | None = None, description: str | None = None, parameters: Dict[str, ParameterSpecification] | None = None, annotations: List[object] | None = None, existing_cluster_id: object | None = None, instance_pool_id: object | None = None, new_cluster_version: object | None = None, new_cluster_num_of_worker: object | None = None, new_cluster_node_type: object | None = None, new_cluster_spark_conf: Dict[str, object] | None = None, new_cluster_spark_env_vars: Dict[str, object] | None = None, new_cluster_custom_tags: Dict[str, object] | None = None, new_cluster_driver_node_type: object | None = None, new_cluster_init_scripts: object | None = None, new_cluster_enable_elastic_disk: object | None = None, encrypted_credential: object | None = None, **kwargs)

Parameters

Name Description
additional_properties
Required

Unmatched properties from the message are deserialized to this collection.

type
Required
str

Required. Type of linked service.Constant filled by server.

connect_via
Required

The integration runtime reference.

description
Required
str

Linked service description.

parameters
Required

Parameters for linked service.

annotations
Required

List of tags that can be used for describing the linked service.

domain
Required

Required. <REGION>.azuredatabricks.net, domain name of your Databricks deployment. Type: string (or Expression with resultType string).

access_token
Required

Required. Access token for databricks REST API. Refer to https://docs.azuredatabricks.net/api/latest/authentication.html. Type: string (or Expression with resultType string).

existing_cluster_id
Required

The id of an existing interactive cluster that will be used for all runs of this activity. Type: string (or Expression with resultType string).

instance_pool_id
Required

The id of an existing instance pool that will be used for all runs of this activity. Type: string (or Expression with resultType string).

new_cluster_version
Required

If not using an existing interactive cluster, this specifies the Spark version of a new job cluster or instance pool nodes created for each run of this activity. Required if instancePoolId is specified. Type: string (or Expression with resultType string).

new_cluster_num_of_worker
Required

If not using an existing interactive cluster, this specifies the number of worker nodes to use for the new job cluster or instance pool. For new job clusters, this a string-formatted Int32, like '1' means numOfWorker is 1 or '1:10' means auto- scale from 1 (min) to 10 (max). For instance pools, this is a string-formatted Int32, and can only specify a fixed number of worker nodes, such as '2'. Required if newClusterVersion is specified. Type: string (or Expression with resultType string).

new_cluster_node_type
Required

The node type of the new job cluster. This property is required if newClusterVersion is specified and instancePoolId is not specified. If instancePoolId is specified, this property is ignored. Type: string (or Expression with resultType string).

new_cluster_spark_conf
Required

A set of optional, user-specified Spark configuration key-value pairs.

new_cluster_spark_env_vars
Required

A set of optional, user-specified Spark environment variables key-value pairs.

new_cluster_custom_tags
Required

Additional tags for cluster resources. This property is ignored in instance pool configurations.

new_cluster_driver_node_type
Required

The driver node type for the new job cluster. This property is ignored in instance pool configurations. Type: string (or Expression with resultType string).

new_cluster_init_scripts
Required

User-defined initialization scripts for the new cluster. Type: array of strings (or Expression with resultType array of strings).

new_cluster_enable_elastic_disk
Required

Enable the elastic disk on the new cluster. This property is now ignored, and takes the default elastic disk behavior in Databricks (elastic disks are always enabled). Type: boolean (or Expression with resultType boolean).

encrypted_credential
Required

The encrypted credential used for authentication. Credentials are encrypted using the integration runtime credential manager. Type: string (or Expression with resultType string).

Keyword-Only Parameters

Name Description
domain
Required
access_token
Required
additional_properties
Required
connect_via
Required
description
Required
parameters
Required
annotations
Required
existing_cluster_id
Required
instance_pool_id
Required
new_cluster_version
Required
new_cluster_num_of_worker
Required
new_cluster_node_type
Required
new_cluster_spark_conf
Required
new_cluster_spark_env_vars
Required
new_cluster_custom_tags
Required
new_cluster_driver_node_type
Required
new_cluster_init_scripts
Required
new_cluster_enable_elastic_disk
Required
encrypted_credential
Required

Methods

as_dict

Return a dict that can be JSONify using json.dump.

Advanced usage might optionally use a callback as parameter:

Key is the attribute name used in Python. Attr_desc is a dict of metadata. Currently contains 'type' with the msrest type and 'key' with the RestAPI encoded key. Value is the current value in this object.

The string returned will be used to serialize the key. If the return type is a list, this is considered hierarchical result dict.

See the three examples in this file:

  • attribute_transformer

  • full_restapi_key_transformer

  • last_restapi_key_transformer

If you want XML serialization, you can pass the kwargs is_xml=True.

deserialize

Parse a str using the RestAPI syntax and return a model.

enable_additional_properties_sending
from_dict

Parse a dict using given key extractor return a model.

By default consider key extractors (rest_key_case_insensitive_extractor, attribute_key_case_insensitive_extractor and last_rest_key_case_insensitive_extractor)

is_xml_model
serialize

Return the JSON that would be sent to azure from this model.

This is an alias to as_dict(full_restapi_key_transformer, keep_readonly=False).

If you want XML serialization, you can pass the kwargs is_xml=True.

validate

Validate this model recursively and return a list of ValidationError.

as_dict

Return a dict that can be JSONify using json.dump.

Advanced usage might optionally use a callback as parameter:

Key is the attribute name used in Python. Attr_desc is a dict of metadata. Currently contains 'type' with the msrest type and 'key' with the RestAPI encoded key. Value is the current value in this object.

The string returned will be used to serialize the key. If the return type is a list, this is considered hierarchical result dict.

See the three examples in this file:

  • attribute_transformer

  • full_restapi_key_transformer

  • last_restapi_key_transformer

If you want XML serialization, you can pass the kwargs is_xml=True.

as_dict(keep_readonly=True, key_transformer=<function attribute_transformer>, **kwargs)

Parameters

Name Description
key_transformer
<xref:function>

A key transformer function.

keep_readonly
default value: True

Returns

Type Description

A dict JSON compatible object

deserialize

Parse a str using the RestAPI syntax and return a model.

deserialize(data, content_type=None)

Parameters

Name Description
data
Required
str

A str using RestAPI structure. JSON by default.

content_type
str

JSON by default, set application/xml if XML.

default value: None

Returns

Type Description

An instance of this model

Exceptions

Type Description
DeserializationError if something went wrong

enable_additional_properties_sending

enable_additional_properties_sending()

from_dict

Parse a dict using given key extractor return a model.

By default consider key extractors (rest_key_case_insensitive_extractor, attribute_key_case_insensitive_extractor and last_rest_key_case_insensitive_extractor)

from_dict(data, key_extractors=None, content_type=None)

Parameters

Name Description
data
Required

A dict using RestAPI structure

content_type
str

JSON by default, set application/xml if XML.

default value: None
key_extractors
default value: None

Returns

Type Description

An instance of this model

Exceptions

Type Description
DeserializationError if something went wrong

is_xml_model

is_xml_model()

serialize

Return the JSON that would be sent to azure from this model.

This is an alias to as_dict(full_restapi_key_transformer, keep_readonly=False).

If you want XML serialization, you can pass the kwargs is_xml=True.

serialize(keep_readonly=False, **kwargs)

Parameters

Name Description
keep_readonly

If you want to serialize the readonly attributes

default value: False

Returns

Type Description

A dict JSON compatible object

validate

Validate this model recursively and return a list of ValidationError.

validate()

Returns

Type Description

A list of validation error