Feedback Edit

HDInsightSparkActivity Class

  • Reference

HDInsight Spark activity.

All required parameters must be populated in order to send to Azure.

Inheritance
azure.synapse.artifacts.models._models_py3.ExecutionActivity
HDInsightSparkActivity

Constructor

HDInsightSparkActivity(*, name: str, root_path: object, entry_file_path: object, additional_properties: Optional[Dict[str, object]] = None, description: Optional[str] = None, depends_on: Optional[List[azure.synapse.artifacts.models._models_py3.ActivityDependency]] = None, user_properties: Optional[List[azure.synapse.artifacts.models._models_py3.UserProperty]] = None, linked_service_name: Optional[azure.synapse.artifacts.models._models_py3.LinkedServiceReference] = None, policy: Optional[azure.synapse.artifacts.models._models_py3.ActivityPolicy] = None, arguments: Optional[List[object]] = None, get_debug_info: Optional[Union[str, azure.synapse.artifacts.models._artifacts_client_enums.HDInsightActivityDebugInfoOption]] = None, spark_job_linked_service: Optional[azure.synapse.artifacts.models._models_py3.LinkedServiceReference] = None, class_name: Optional[str] = None, proxy_user: Optional[object] = None, spark_config: Optional[Dict[str, object]] = None, **kwargs)

Parameters

additional_properties
dict[str, object]
Required

Unmatched properties from the message are deserialized to this collection.

name
str
Required

Required. Activity name.

type
str
Required

Required. Type of activity.Constant filled by server.

description
str
Required

Activity description.

depends_on
list[ActivityDependency]
Required

Activity depends on condition.

user_properties
list[UserProperty]
Required

Activity user properties.

linked_service_name
LinkedServiceReference
Required

Linked service reference.

policy
ActivityPolicy
Required

Activity policy.

root_path
object
Required

Required. The root path in 'sparkJobLinkedService' for all the job's files. Type: string (or Expression with resultType string).

entry_file_path
object
Required

Required. The relative path to the root folder of the code/package to be executed. Type: string (or Expression with resultType string).

arguments
list[object]
Required

The user-specified arguments to HDInsightSparkActivity.

get_debug_info
str or HDInsightActivityDebugInfoOption
Required

Debug info option. Possible values include: "None", "Always", "Failure".

spark_job_linked_service
LinkedServiceReference
Required

The storage linked service for uploading the entry file and dependencies, and for receiving logs.

class_name
str
Required

The application's Java/Spark main class.

proxy_user
object
Required

The user to impersonate that will execute the job. Type: string (or Expression with resultType string).

spark_config
dict[str, object]
Required

Spark configuration property.