SparkClient Class

SparkClient.

Inheritance
builtins.object
SparkClient

Constructor

SparkClient(credential: 'TokenCredential', endpoint: str, spark_pool_name: str, livy_api_version: str = '2019-11-01-preview', **kwargs: Any)

Parameters

Name Description
credential
Required

Credential needed for the client to connect to Azure.

endpoint
Required
str

The workspace development endpoint, for example https://myworkspace.dev.azuresynapse.net.

spark_pool_name
Required
str

Name of the spark pool.

livy_api_version
str

Valid api-version for the request.

default value: 2019-11-01-preview

Keyword-Only Parameters

Name Description
polling_interval
int

Default waiting time between two polls for LRO operations if no Retry-After header is present.

Variables

Name Description
spark_batch

SparkBatchOperations operations

spark_session

SparkSessionOperations operations

Methods

close

close

close() -> None