AzureDatabricksLinkedService Class
Azure Databricks linked service.
All required parameters must be populated in order to send to Azure.
- Inheritance
-
azure.synapse.artifacts.models._models_py3.LinkedServiceAzureDatabricksLinkedService
Constructor
AzureDatabricksLinkedService(*, domain: object, access_token: SecretBase, additional_properties: Dict[str, object] | None = None, connect_via: IntegrationRuntimeReference | None = None, description: str | None = None, parameters: Dict[str, ParameterSpecification] | None = None, annotations: List[object] | None = None, existing_cluster_id: object | None = None, instance_pool_id: object | None = None, new_cluster_version: object | None = None, new_cluster_num_of_worker: object | None = None, new_cluster_node_type: object | None = None, new_cluster_spark_conf: Dict[str, object] | None = None, new_cluster_spark_env_vars: Dict[str, object] | None = None, new_cluster_custom_tags: Dict[str, object] | None = None, new_cluster_driver_node_type: object | None = None, new_cluster_init_scripts: object | None = None, new_cluster_enable_elastic_disk: object | None = None, encrypted_credential: object | None = None, **kwargs)
Parameters
Name | Description |
---|---|
additional_properties
Required
|
Unmatched properties from the message are deserialized to this collection. |
type
Required
|
Required. Type of linked service.Constant filled by server. |
connect_via
Required
|
The integration runtime reference. |
description
Required
|
Linked service description. |
parameters
Required
|
Parameters for linked service. |
annotations
Required
|
List of tags that can be used for describing the linked service. |
domain
Required
|
Required. |
access_token
Required
|
Required. Access token for databricks REST API. Refer to https://docs.azuredatabricks.net/api/latest/authentication.html. Type: string (or Expression with resultType string). |
existing_cluster_id
Required
|
The id of an existing interactive cluster that will be used for all runs of this activity. Type: string (or Expression with resultType string). |
instance_pool_id
Required
|
The id of an existing instance pool that will be used for all runs of this activity. Type: string (or Expression with resultType string). |
new_cluster_version
Required
|
If not using an existing interactive cluster, this specifies the Spark version of a new job cluster or instance pool nodes created for each run of this activity. Required if instancePoolId is specified. Type: string (or Expression with resultType string). |
new_cluster_num_of_worker
Required
|
If not using an existing interactive cluster, this specifies the number of worker nodes to use for the new job cluster or instance pool. For new job clusters, this a string-formatted Int32, like '1' means numOfWorker is 1 or '1:10' means auto- scale from 1 (min) to 10 (max). For instance pools, this is a string-formatted Int32, and can only specify a fixed number of worker nodes, such as '2'. Required if newClusterVersion is specified. Type: string (or Expression with resultType string). |
new_cluster_node_type
Required
|
The node type of the new job cluster. This property is required if newClusterVersion is specified and instancePoolId is not specified. If instancePoolId is specified, this property is ignored. Type: string (or Expression with resultType string). |
new_cluster_spark_conf
Required
|
A set of optional, user-specified Spark configuration key-value pairs. |
new_cluster_spark_env_vars
Required
|
A set of optional, user-specified Spark environment variables key-value pairs. |
new_cluster_custom_tags
Required
|
Additional tags for cluster resources. This property is ignored in instance pool configurations. |
new_cluster_driver_node_type
Required
|
The driver node type for the new job cluster. This property is ignored in instance pool configurations. Type: string (or Expression with resultType string). |
new_cluster_init_scripts
Required
|
User-defined initialization scripts for the new cluster. Type: array of strings (or Expression with resultType array of strings). |
new_cluster_enable_elastic_disk
Required
|
Enable the elastic disk on the new cluster. This property is now ignored, and takes the default elastic disk behavior in Databricks (elastic disks are always enabled). Type: boolean (or Expression with resultType boolean). |
encrypted_credential
Required
|
The encrypted credential used for authentication. Credentials are encrypted using the integration runtime credential manager. Type: string (or Expression with resultType string). |
Keyword-Only Parameters
Name | Description |
---|---|
domain
Required
|
|
access_token
Required
|
|
additional_properties
Required
|
|
connect_via
Required
|
|
description
Required
|
|
parameters
Required
|
|
annotations
Required
|
|
existing_cluster_id
Required
|
|
instance_pool_id
Required
|
|
new_cluster_version
Required
|
|
new_cluster_num_of_worker
Required
|
|
new_cluster_node_type
Required
|
|
new_cluster_spark_conf
Required
|
|
new_cluster_spark_env_vars
Required
|
|
new_cluster_custom_tags
Required
|
|
new_cluster_driver_node_type
Required
|
|
new_cluster_init_scripts
Required
|
|
new_cluster_enable_elastic_disk
Required
|
|
encrypted_credential
Required
|
|
Methods
as_dict |
Return a dict that can be JSONify using json.dump. Advanced usage might optionally use a callback as parameter: Key is the attribute name used in Python. Attr_desc is a dict of metadata. Currently contains 'type' with the msrest type and 'key' with the RestAPI encoded key. Value is the current value in this object. The string returned will be used to serialize the key. If the return type is a list, this is considered hierarchical result dict. See the three examples in this file:
If you want XML serialization, you can pass the kwargs is_xml=True. |
deserialize |
Parse a str using the RestAPI syntax and return a model. |
enable_additional_properties_sending | |
from_dict |
Parse a dict using given key extractor return a model. By default consider key extractors (rest_key_case_insensitive_extractor, attribute_key_case_insensitive_extractor and last_rest_key_case_insensitive_extractor) |
is_xml_model | |
serialize |
Return the JSON that would be sent to azure from this model. This is an alias to as_dict(full_restapi_key_transformer, keep_readonly=False). If you want XML serialization, you can pass the kwargs is_xml=True. |
validate |
Validate this model recursively and return a list of ValidationError. |
as_dict
Return a dict that can be JSONify using json.dump.
Advanced usage might optionally use a callback as parameter:
Key is the attribute name used in Python. Attr_desc is a dict of metadata. Currently contains 'type' with the msrest type and 'key' with the RestAPI encoded key. Value is the current value in this object.
The string returned will be used to serialize the key. If the return type is a list, this is considered hierarchical result dict.
See the three examples in this file:
attribute_transformer
full_restapi_key_transformer
last_restapi_key_transformer
If you want XML serialization, you can pass the kwargs is_xml=True.
as_dict(keep_readonly=True, key_transformer=<function attribute_transformer>, **kwargs)
Parameters
Name | Description |
---|---|
key_transformer
|
<xref:function>
A key transformer function. |
keep_readonly
|
default value: True
|
Returns
Type | Description |
---|---|
A dict JSON compatible object |
deserialize
Parse a str using the RestAPI syntax and return a model.
deserialize(data, content_type=None)
Parameters
Name | Description |
---|---|
data
Required
|
A str using RestAPI structure. JSON by default. |
content_type
|
JSON by default, set application/xml if XML. default value: None
|
Returns
Type | Description |
---|---|
An instance of this model |
Exceptions
Type | Description |
---|---|
DeserializationError if something went wrong
|
enable_additional_properties_sending
enable_additional_properties_sending()
from_dict
Parse a dict using given key extractor return a model.
By default consider key extractors (rest_key_case_insensitive_extractor, attribute_key_case_insensitive_extractor and last_rest_key_case_insensitive_extractor)
from_dict(data, key_extractors=None, content_type=None)
Parameters
Name | Description |
---|---|
data
Required
|
A dict using RestAPI structure |
content_type
|
JSON by default, set application/xml if XML. default value: None
|
key_extractors
|
default value: None
|
Returns
Type | Description |
---|---|
An instance of this model |
Exceptions
Type | Description |
---|---|
DeserializationError if something went wrong
|
is_xml_model
is_xml_model()
serialize
Return the JSON that would be sent to azure from this model.
This is an alias to as_dict(full_restapi_key_transformer, keep_readonly=False).
If you want XML serialization, you can pass the kwargs is_xml=True.
serialize(keep_readonly=False, **kwargs)
Parameters
Name | Description |
---|---|
keep_readonly
|
If you want to serialize the readonly attributes default value: False
|
Returns
Type | Description |
---|---|
A dict JSON compatible object |
validate
Validate this model recursively and return a list of ValidationError.
validate()
Returns
Type | Description |
---|---|
A list of validation error |
Azure SDK for Python
Feedback
https://aka.ms/ContentUserFeedback.
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see:Submit and view feedback for