HDInsightStreamingActivity Class

HDInsight streaming activity type.

All required parameters must be populated in order to send to Azure.

Inheritance

azure.mgmt.datafactory.models._models_py3.ExecutionActivity

HDInsightStreamingActivity

Constructor

HDInsightStreamingActivity(*, name: str, mapper: Any, reducer: Any, input: Any, output: Any, file_paths: List[Any], additional_properties: Optional[Dict[str, Any]] = None, description: Optional[str] = None, depends_on: Optional[List[_models.ActivityDependency]] = None, user_properties: Optional[List[_models.UserProperty]] = None, linked_service_name: Optional[_models.LinkedServiceReference] = None, policy: Optional[_models.ActivityPolicy] = None, storage_linked_services: Optional[List[_models.LinkedServiceReference]] = None, arguments: Optional[List[Any]] = None, get_debug_info: Optional[Union[str, _models.HDInsightActivityDebugInfoOption]] = None, file_linked_service: Optional[_models.LinkedServiceReference] = None, combiner: Optional[Any] = None, command_environment: Optional[List[Any]] = None, defines: Optional[Dict[str, Any]] = None, **kwargs)

Variables

additional_properties

dict[str, any]

Unmatched properties from the message are deserialized to this collection.

name

str

Required. Activity name.

type

str

Required. Type of activity.Constant filled by server.

description

str

Activity description.

depends_on

list[ActivityDependency]

Activity depends on condition.

user_properties

list[UserProperty]

Activity user properties.

linked_service_name

LinkedServiceReference

Linked service reference.

policy

ActivityPolicy

Activity policy.

storage_linked_services

list[LinkedServiceReference]

Storage linked service references.

arguments

list[any]

User specified arguments to HDInsightActivity.

get_debug_info

str or HDInsightActivityDebugInfoOption

Debug info option. Known values are: "None", "Always", "Failure".

mapper

any

Required. Mapper executable name. Type: string (or Expression with resultType string).

reducer

any

Required. Reducer executable name. Type: string (or Expression with resultType string).

input

any

Required. Input blob path. Type: string (or Expression with resultType string).

output

any

Required. Output blob path. Type: string (or Expression with resultType string).

file_paths

list[any]

Required. Paths to streaming job files. Can be directories.

file_linked_service

LinkedServiceReference

Linked service reference where the files are located.

combiner

any

Combiner executable name. Type: string (or Expression with resultType string).

command_environment

list[any]

Command line environment values.

defines

dict[str, any]

Allows user to specify defines for streaming job request.