DataStreamReader Class

Definition

Namespace:

Microsoft.Spark.Sql.Streaming

Assembly:

Microsoft.Spark.dll

Package:

Microsoft.Spark v1.0.0

DataStreamReader provides functionality to load a streaming DataFrame from external storage systems (e.g. file systems, key-value stores, etc).

public sealed class DataStreamReader

type DataStreamReader = class

Public NotInheritable Class DataStreamReader

Inheritance

Object

DataStreamReader

Methods

Csv(String)	Loads a CSV file stream and returns the result as a DataFrame.
Format(String)	Specifies the input data source format.
Json(String)	Loads a JSON file stream and returns the results as a DataFrame.
Load()	Loads input data stream in as a DataFrame, for data streams that don't require a path (e.g.external key-value stores).
Load(String)	Loads input in as a DataFrame, for data streams that read from some path.
Option(String, Boolean)	Adds an input option for the underlying data source.
Option(String, Double)	Adds an input option for the underlying data source.
Option(String, Int64)	Adds an input option for the underlying data source.
Option(String, String)	Adds an input option for the underlying data source.
Options(Dictionary<String,String>)	Adds input options for the underlying data source.
Orc(String)	Loads a ORC file stream and returns the result as a DataFrame.
Parquet(String)	Loads a Parquet file stream and returns the result as a DataFrame.
Schema(String)	Specifies the schema by using the given DDL-formatted string.
Schema(StructType)	Specifies the schema by using StructType.
Text(String)	Loads text files and returns a DataFrame whose schema starts with a string column named "value", and followed by partitioned columns if there are any.