DataFrameNaFunctions.Drop Method

Definition

Namespace:

Microsoft.Spark.Sql

Assembly:

Microsoft.Spark.dll

Package:

Microsoft.Spark v1.0.0

Overloads

Drop()	Returns a new DataFrame that drops rows containing any null or NaN values.
Drop(IEnumerable<String>)	Returns a new DataFrame that drops rows containing any null or NaN values in the specified columns.
Drop(Int32)	Returns a new DataFrame that drops rows containing less than minNonNulls non-null and non-NaN values.
Drop(String)	Returns a new DataFrame that drops rows containing null or NaN values.
Drop(Int32, IEnumerable<String>)	Returns a new DataFrame that drops rows containing less than minNonNulls non-null and non-NaN values in the specified columns.
Drop(String, IEnumerable<String>)	Returns a new DataFrame that drops rows containing any null or NaN values in the specified columns.

Drop()

Returns a new DataFrame that drops rows containing any null or NaN values.

public Microsoft.Spark.Sql.DataFrame Drop ();

member this.Drop : unit -> Microsoft.Spark.Sql.DataFrame

Public Function Drop () As DataFrame

Returns

DataFrame

DataFrame object

Drop(IEnumerable<String>)

Returns a new DataFrame that drops rows containing any null or NaN values in the specified columns.

public Microsoft.Spark.Sql.DataFrame Drop (System.Collections.Generic.IEnumerable<string> columnNames);

member this.Drop : seq<string> -> Microsoft.Spark.Sql.DataFrame

Public Function Drop (columnNames As IEnumerable(Of String)) As DataFrame

Parameters

columnNames

IEnumerable<String>

Column names

Returns

DataFrame

DataFrame object

Drop(Int32)

Returns a new DataFrame that drops rows containing less than minNonNulls non-null and non-NaN values.

public Microsoft.Spark.Sql.DataFrame Drop (int minNonNulls);

member this.Drop : int -> Microsoft.Spark.Sql.DataFrame

Public Function Drop (minNonNulls As Integer) As DataFrame

Parameters

minNonNulls

Int32

Returns

DataFrame

DataFrame object

Drop(String)

Returns a new DataFrame that drops rows containing null or NaN values.

public Microsoft.Spark.Sql.DataFrame Drop (string how);

member this.Drop : string -> Microsoft.Spark.Sql.DataFrame

Public Function Drop (how As String) As DataFrame

Parameters

how

String

Determines the behavior of dropping rows

Returns

DataFrame

DataFrame object

Remarks

If `how` is "any", then drop rows containing any null or NaN values. If `how` is "all", then drop rows only if every column is null or NaN for that row.

Drop(Int32, IEnumerable<String>)

Returns a new DataFrame that drops rows containing less than minNonNulls non-null and non-NaN values in the specified columns.

public Microsoft.Spark.Sql.DataFrame Drop (int minNonNulls, System.Collections.Generic.IEnumerable<string> columnNames);

member this.Drop : int * seq<string> -> Microsoft.Spark.Sql.DataFrame

Public Function Drop (minNonNulls As Integer, columnNames As IEnumerable(Of String)) As DataFrame

Parameters

minNonNulls

Int32

columnNames

IEnumerable<String>

Column names

Returns

DataFrame

DataFrame object

Drop(String, IEnumerable<String>)

Returns a new DataFrame that drops rows containing any null or NaN values in the specified columns.

public Microsoft.Spark.Sql.DataFrame Drop (string how, System.Collections.Generic.IEnumerable<string> columnNames);

member this.Drop : string * seq<string> -> Microsoft.Spark.Sql.DataFrame

Public Function Drop (how As String, columnNames As IEnumerable(Of String)) As DataFrame

Parameters

how

String

Determines the behavior of dropping rows

columnNames

IEnumerable<String>

Column names

Returns

DataFrame

DataFrame object

Remarks

If `how` is "any", then drop rows containing any null or NaN values. If `how` is "all", then drop rows only if every column is null or NaN for that row.