DataFrameNaFunctions Class

Definition

Namespace:

Microsoft.Spark.Sql

Assembly:

Microsoft.Spark.dll

Package:

Microsoft.Spark v1.0.0

Provides functionalities for working with missing data in DataFrame.

public sealed class DataFrameNaFunctions

type DataFrameNaFunctions = class

Public NotInheritable Class DataFrameNaFunctions

Inheritance

Object

DataFrameNaFunctions

Methods

Drop()	Returns a new DataFrame that drops rows containing any null or NaN values.
Drop(IEnumerable<String>)	Returns a new DataFrame that drops rows containing any null or NaN values in the specified columns.
Drop(Int32)	Returns a new DataFrame that drops rows containing less than minNonNulls non-null and non-NaN values.
Drop(Int32, IEnumerable<String>)	Returns a new DataFrame that drops rows containing less than minNonNulls non-null and non-NaN values in the specified columns.
Drop(String)	Returns a new DataFrame that drops rows containing null or NaN values.
Drop(String, IEnumerable<String>)	Returns a new DataFrame that drops rows containing any null or NaN values in the specified columns.
Fill(Boolean)	Returns a new DataFrame that replaces null values in boolean columns with value.
Fill(Boolean, IEnumerable<String>)	Returns a new DataFrame that replaces null or NaN values in specified boolean columns. If a specified column is not a boolean column, it is ignored.
Fill(Double)	Returns a new DataFrame that replaces null or NaN values in numeric columns with value.
Fill(Double, IEnumerable<String>)	Returns a new DataFrame that replaces null or NaN values in specified numeric columns. If a specified column is not a numeric column, it is ignored.
Fill(IDictionary<String,Boolean>)	Returns a new DataFrame that replaces null values.
Fill(IDictionary<String,Double>)	Returns a new DataFrame that replaces null values.
Fill(IDictionary<String,Int32>)	Returns a new DataFrame that replaces null values.
Fill(IDictionary<String,Int64>)	Returns a new DataFrame that replaces null values.
Fill(IDictionary<String,String>)	Returns a new DataFrame that replaces null values.
Fill(Int64)	Returns a new DataFrame that replaces null or NaN values in numeric columns with value.
Fill(Int64, IEnumerable<String>)	Returns a new DataFrame that replaces null or NaN values in specified numeric columns. If a specified column is not a numeric column, it is ignored.
Fill(String)	Returns a new DataFrame that replaces null or NaN values in numeric columns with value.
Fill(String, IEnumerable<String>)	Returns a new DataFrame that replaces null or NaN values in specified string columns. If a specified column is not a string column, it is ignored.
Replace(IEnumerable<String>, IDictionary<Boolean,Boolean>)	Replaces values matching keys in replacement map with the corresponding values.
Replace(IEnumerable<String>, IDictionary<Double,Double>)	Replaces values matching keys in replacement map with the corresponding values.
Replace(IEnumerable<String>, IDictionary<String,String>)	Replaces values matching keys in replacement map with the corresponding values.
Replace(String, IDictionary<Boolean,Boolean>)	Replaces values matching keys in replacement map with the corresponding values.
Replace(String, IDictionary<Double,Double>)	Replaces values matching keys in replacement map with the corresponding values.
Replace(String, IDictionary<String,String>)	Replaces values matching keys in replacement map with the corresponding values.