JobStatisticsVertexStage Class
The Data Lake Analytics job statistics vertex stage information.
Variables are only populated by the server, and will be ignored when sending a request.
- Inheritance
-
JobStatisticsVertexStage
Constructor
JobStatisticsVertexStage(**kwargs)Parameters
- max_peak_mem_usage_vertex
- JobStatisticsVertex
the vertex with the maximum peak memory usage.
- allocated_container_cpu_core_count
- ResourceUsageStatistics
The statistics information for the allocated container CPU core count.
- allocated_container_mem_size
- ResourceUsageStatistics
The statistics information for the allocated container memory size.
- used_vertex_cpu_core_count
- ResourceUsageStatistics
The statistics information for the used vertex CPU core count.
- used_vertex_peak_mem_size
- ResourceUsageStatistics
The statistics information for the used vertex peak memory size.
Variables
- data_read
- <xref:long>
The amount of data read, in bytes.
- data_read_cross_pod
- <xref:long>
The amount of data read across multiple pods, in bytes.
- data_read_intra_pod
- <xref:long>
The amount of data read in one pod, in bytes.
- data_to_read
- <xref:long>
The amount of data remaining to be read, in bytes.
- data_written
- <xref:long>
The amount of data written, in bytes.
- duplicate_discard_count
- int
The number of duplicates that were discarded.
- failed_count
- int
The number of failures that occured in this stage.
- max_vertex_data_read
- <xref:long>
The maximum amount of data read in a single vertex, in bytes.
- min_vertex_data_read
- <xref:long>
The minimum amount of data read in a single vertex, in bytes.
- read_failure_count
- int
The number of read failures in this stage.
- revocation_count
- int
The number of vertices that were revoked during this stage.
- running_count
- int
The number of currently running vertices in this stage.
- scheduled_count
- int
The number of currently scheduled vertices in this stage.
- stage_name
- str
The name of this stage in job execution.
- succeeded_count
- int
The number of vertices that succeeded in this stage.
- temp_data_written
- <xref:long>
The amount of temporary data written, in bytes.
- total_count
- int
The total vertex count for this stage.
- total_failed_time
- <xref:timedelta>
The amount of time that failed vertices took up in this stage.
- total_progress
- int
The current progress of this stage, as a percentage.
- total_succeeded_time
- <xref:timedelta>
The amount of time all successful vertices took in this stage.
- total_peak_mem_usage
- <xref:long>
The sum of the peak memory usage of all the vertices in the stage, in bytes.
- total_execution_time
- <xref:timedelta>
The sum of the total execution time of all the vertices in the stage.
- estimated_vertex_cpu_core_count
- int
The estimated vertex CPU core count.
- estimated_vertex_peak_cpu_core_count
- int
The estimated vertex peak CPU core count.
- estimated_vertex_mem_size
- <xref:long>
The estimated vertex memory size, in bytes.
Feedback
Submit and view feedback for