Share via


DataFrameWriterV2 Class

Definition

Interface used to write a DataFrame to external storage using the v2 API.

[Microsoft.Spark.Since("3.0.0")]
public sealed class DataFrameWriterV2
[<Microsoft.Spark.Since("3.0.0")>]
type DataFrameWriterV2 = class
Public NotInheritable Class DataFrameWriterV2
Inheritance
DataFrameWriterV2
Attributes

Methods

Append()

Append the contents of the data frame to the output table.

Create()

Create a new table from the contents of the data frame.

CreateOrReplace()

Create a new table or replace an existing table with the contents of the data frame.

Option(String, Boolean)

Adds an output option for the underlying data source.

Option(String, Double)

Adds an output option for the underlying data source.

Option(String, Int64)

Adds an output option for the underlying data source.

Option(String, String)

Adds an output option for the underlying data source.

Options(Dictionary<String,String>)

Adds output options for the underlying data source.

Overwrite(Column)

Overwrite rows matching the given filter condition with the contents of the data frame in the output table.

OverwritePartitions()

Overwrite all partition for which the data frame contains at least one row with the contents of the data frame in the output table.

PartitionedBy(Column, Column[])

Partition the output table created by Create(), CreateOrReplace(), or Replace() using the given columns or transforms.

Replace()

Replace an existing table with the contents of the data frame.

TableProperty(String, String)

Add a table property.

Using(String)

Specifies a provider for the underlying output data source. Spark's default catalog supports "parquet", "json", etc.

Applies to