IDFModel Class

Definition

A IDFModel that converts the input string to lowercase and then splits it by white spaces.

public class IDFModel : Microsoft.Spark.ML.Feature.FeatureBase<Microsoft.Spark.ML.Feature.IDFModel>
type IDFModel = class
    inherit FeatureBase<IDFModel>
Public Class IDFModel
Inherits FeatureBase(Of IDFModel)
Inheritance

Constructors

IDFModel()

Create a IDFModel without any parameters

IDFModel(String)

Create a IDFModel with a UID that is used to give the IDFModel a unique ID

Methods

Clear(Param)

Clears any value that was previously set for this Microsoft.Spark.ML.Feature.Param. The value is reset to the default value.

(Inherited from FeatureBase<T>)
ExplainParam(Param)

Returns a description of how a specific Microsoft.Spark.ML.Feature.Param works and is currently set.

(Inherited from FeatureBase<T>)
ExplainParams()

Returns a description of how all of the Microsoft.Spark.ML.Feature.Param's that apply to this object work and how they are currently set.

(Inherited from FeatureBase<T>)
GetInputCol()

Gets the column that the IDFModel should read from

GetMinDocFreq()

Minimum of documents in which a term should appear for filtering

GetOutputCol()

The IDFModel will create a new column in the DataFrame, this is the name of the new column.

GetParam(String)

Retrieves a Microsoft.Spark.ML.Feature.Param so that it can be used to set the value of the Microsoft.Spark.ML.Feature.Param on the object.

(Inherited from FeatureBase<T>)
Load(String)

Loads the IDFModel that was previously saved using Save

Save(String)

Saves the object so that it can be loaded later using Load. Note that these objects can be shared with Scala by Loading or Saving in Scala.

(Inherited from FeatureBase<T>)
Set(Param, Object)

Sets the value of a specific Microsoft.Spark.ML.Feature.Param.

(Inherited from FeatureBase<T>)
SetInputCol(String)

Sets the column that the IDFModel should read from and convert into buckets

SetOutputCol(String)

The IDFModel will create a new column in the DataFrame, this is the name of the new column.

ToString()

Returns the JVM toString value rather than the .NET ToString default

(Inherited from FeatureBase<T>)
Transform(DataFrame)

Executes the IDFModel and transforms the DataFrame to include the new column or columns with the tokens.

Uid()

The UID that was used to create the object. If no UID is passed in when creating the object then a random UID is created when the object is created.

(Inherited from FeatureBase<T>)

Applies to