Share via

SparkContext.SetJobGroup(String, String, Boolean) Method

  • Reference

Definition

Namespace:
Microsoft.Spark
Assembly:
Microsoft.Spark.dll
Package:
Microsoft.Spark v1.0.0

Assigns a group ID to all the jobs started by this thread until the group ID is set to a different value or cleared.

public void SetJobGroup (string groupId, string description, bool interruptOnCancel = false);
member this.SetJobGroup : string * string * bool -> unit
Public Sub SetJobGroup (groupId As String, description As String, Optional interruptOnCancel As Boolean = false)

Parameters

groupId
String

Group Id

description
String

Description on the job group

interruptOnCancel
Boolean

If true, then job cancellation will result in Thread.interrupt() being called on the job's executor threads.

Remarks

Often, a unit of execution in an application consists of multiple Spark actions or jobs. Application programmers can use this method to group all those jobs together and give a group description. Once set, the Spark web UI will associate such jobs with this group.

Applies to