DataFrame.ToLocalIterator Method

Definition

Namespace:

Microsoft.Spark.Sql

Assembly:

Microsoft.Spark.dll

Package:

Microsoft.Spark v1.0.0

Overloads

ToLocalIterator(Boolean)	Returns an iterator that contains all of the rows in this DataFrame. The iterator will consume as much memory as the largest partition in this DataFrame. With prefetch it may consume up to the memory of the 2 largest partitions.
ToLocalIterator()	Returns an iterator that contains all of the rows in this DataFrame. The iterator will consume as much memory as the largest partition in this DataFrame.

ToLocalIterator(Boolean)

Returns an iterator that contains all of the rows in this DataFrame. The iterator will consume as much memory as the largest partition in this DataFrame. With prefetch it may consume up to the memory of the 2 largest partitions.

[Microsoft.Spark.Since("3.0.0")]
public System.Collections.Generic.IEnumerable<Microsoft.Spark.Sql.Row> ToLocalIterator (bool prefetchPartitions);

[<Microsoft.Spark.Since("3.0.0")>]
member this.ToLocalIterator : bool -> seq<Microsoft.Spark.Sql.Row>

Public Iterator Function ToLocalIterator (prefetchPartitions As Boolean) As IEnumerable(Of Row)

Parameters

prefetchPartitions

Boolean

If Spark should pre-fetch the next partition before it is needed.

Returns

IEnumerable<Row>

Row objects

Attributes

SinceAttribute

ToLocalIterator()

Returns an iterator that contains all of the rows in this DataFrame. The iterator will consume as much memory as the largest partition in this DataFrame.

public System.Collections.Generic.IEnumerable<Microsoft.Spark.Sql.Row> ToLocalIterator ();

member this.ToLocalIterator : unit -> seq<Microsoft.Spark.Sql.Row>

Public Function ToLocalIterator () As IEnumerable(Of Row)

Returns

IEnumerable<Row>

Row objects