DataFrame.ToLocalIterator Method

Definition

Namespace:
Microsoft.Spark.Sql
Assembly:
Microsoft.Spark.dll
Package:
Microsoft.Spark v1.0.0

Overloads

ToLocalIterator(Boolean)

Returns an iterator that contains all of the rows in this DataFrame. The iterator will consume as much memory as the largest partition in this DataFrame. With prefetch it may consume up to the memory of the 2 largest partitions.
ToLocalIterator()

Returns an iterator that contains all of the rows in this DataFrame. The iterator will consume as much memory as the largest partition in this DataFrame.

ToLocalIterator(Boolean)

Returns an iterator that contains all of the rows in this DataFrame. The iterator will consume as much memory as the largest partition in this DataFrame. With prefetch it may consume up to the memory of the 2 largest partitions.

[Microsoft.Spark.Since("3.0.0")]
public System.Collections.Generic.IEnumerable<Microsoft.Spark.Sql.Row> ToLocalIterator (bool prefetchPartitions);
[<Microsoft.Spark.Since("3.0.0")>]
member this.ToLocalIterator : bool -> seq<Microsoft.Spark.Sql.Row>
Public Iterator Function ToLocalIterator (prefetchPartitions As Boolean) As IEnumerable(Of Row)

Parameters

prefetchPartitions
Boolean

If Spark should pre-fetch the next partition before it is needed.

Returns

IEnumerable<Row>

Row objects

Attributes
SinceAttribute

Applies to

ToLocalIterator()

Returns an iterator that contains all of the rows in this DataFrame. The iterator will consume as much memory as the largest partition in this DataFrame.

public System.Collections.Generic.IEnumerable<Microsoft.Spark.Sql.Row> ToLocalIterator ();
member this.ToLocalIterator : unit -> seq<Microsoft.Spark.Sql.Row>
Public Function ToLocalIterator () As IEnumerable(Of Row)

Returns

IEnumerable<Row>

Row objects

Applies to