DataFrameWriterV2 Class

Definition

Namespace:

Microsoft.Spark.Sql

Assembly:

Microsoft.Spark.dll

Package:

Microsoft.Spark v1.0.0

Interface used to write a DataFrame to external storage using the v2 API.

[Microsoft.Spark.Since("3.0.0")]
public sealed class DataFrameWriterV2

[<Microsoft.Spark.Since("3.0.0")>]
type DataFrameWriterV2 = class

Public NotInheritable Class DataFrameWriterV2

Inheritance

Object

DataFrameWriterV2

Attributes

SinceAttribute

Methods

Append()	Append the contents of the data frame to the output table.
Create()	Create a new table from the contents of the data frame.
CreateOrReplace()	Create a new table or replace an existing table with the contents of the data frame.
Option(String, Boolean)	Adds an output option for the underlying data source.
Option(String, Double)	Adds an output option for the underlying data source.
Option(String, Int64)	Adds an output option for the underlying data source.
Option(String, String)	Adds an output option for the underlying data source.
Options(Dictionary<String,String>)	Adds output options for the underlying data source.
Overwrite(Column)	Overwrite rows matching the given filter condition with the contents of the data frame in the output table.
OverwritePartitions()	Overwrite all partition for which the data frame contains at least one row with the contents of the data frame in the output table.
PartitionedBy(Column, Column[])	Partition the output table created by Create(), CreateOrReplace(), or Replace() using the given columns or transforms.
Replace()	Replace an existing table with the contents of the data frame.
TableProperty(String, String)	Add a table property.
Using(String)	Specifies a provider for the underlying output data source. Spark's default catalog supports "parquet", "json", etc.