HDInsightSparkActivity Class

HDInsight Spark activity.

All required parameters must be populated in order to send to Azure.

Inheritance

azure.mgmt.datafactory.models._models_py3.ExecutionActivity

HDInsightSparkActivity

Constructor

HDInsightSparkActivity(*, name: str, root_path: Any, entry_file_path: Any, additional_properties: Optional[Dict[str, Any]] = None, description: Optional[str] = None, depends_on: Optional[List[_models.ActivityDependency]] = None, user_properties: Optional[List[_models.UserProperty]] = None, linked_service_name: Optional[_models.LinkedServiceReference] = None, policy: Optional[_models.ActivityPolicy] = None, arguments: Optional[List[Any]] = None, get_debug_info: Optional[Union[str, _models.HDInsightActivityDebugInfoOption]] = None, spark_job_linked_service: Optional[_models.LinkedServiceReference] = None, class_name: Optional[str] = None, proxy_user: Optional[Any] = None, spark_config: Optional[Dict[str, Any]] = None, **kwargs)

Variables

additional_properties

dict[str, any]

Unmatched properties from the message are deserialized to this collection.

name

str

Required. Activity name.

type

str

Required. Type of activity.Constant filled by server.

description

str

Activity description.

depends_on

list[ActivityDependency]

Activity depends on condition.

user_properties

list[UserProperty]

Activity user properties.

linked_service_name

LinkedServiceReference

Linked service reference.

policy

ActivityPolicy

Activity policy.

root_path

any

Required. The root path in 'sparkJobLinkedService' for all the job's files. Type: string (or Expression with resultType string).

entry_file_path

any

Required. The relative path to the root folder of the code/package to be executed. Type: string (or Expression with resultType string).

arguments

list[any]

The user-specified arguments to HDInsightSparkActivity.

get_debug_info

str or HDInsightActivityDebugInfoOption

Debug info option. Known values are: "None", "Always", "Failure".

spark_job_linked_service

LinkedServiceReference

The storage linked service for uploading the entry file and dependencies, and for receiving logs.

class_name

str

The application's Java/Spark main class.

proxy_user

any

The user to impersonate that will execute the job. Type: string (or Expression with resultType string).

spark_config

dict[str, any]

Spark configuration property.