SparkSource Class

Definition

A copy activity Spark Server source.

[System.Text.Json.Serialization.JsonConverter(typeof(Azure.Analytics.Synapse.Artifacts.Models.SparkSource+SparkSourceConverter))]
public class SparkSource : Azure.Analytics.Synapse.Artifacts.Models.TabularSource
[<System.Text.Json.Serialization.JsonConverter(typeof(Azure.Analytics.Synapse.Artifacts.Models.SparkSource+SparkSourceConverter))>]
type SparkSource = class
    inherit TabularSource
Public Class SparkSource
Inherits TabularSource
Inheritance
Attributes

Constructors

SparkSource()

Initializes a new instance of SparkSource.

Properties

AdditionalColumns

Specifies the additional columns to be added to source data. Type: array of objects (or Expression with resultType array of objects).

(Inherited from TabularSource)
Item[String]

Gets or sets the element with the specified key.

(Inherited from CopySource)
Keys

Gets an ICollection<T> containing the keys of the IDictionary<TKey,TValue>.

(Inherited from CopySource)
MaxConcurrentConnections

The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer).

(Inherited from CopySource)
Query

A query to retrieve data from source. Type: string (or Expression with resultType string).

QueryTimeout

Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])).

(Inherited from TabularSource)
SourceRetryCount

Source retry count. Type: integer (or Expression with resultType integer).

(Inherited from CopySource)
SourceRetryWait

Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])).

(Inherited from CopySource)
Values

Gets an ICollection<T> containing the values in the IDictionary<TKey,TValue>.

(Inherited from CopySource)

Methods

Add(String, Object)

Adds an element with the provided key and value to the IDictionary<TKey,TValue>.

(Inherited from CopySource)
ContainsKey(String)

Determines whether the IDictionary<TKey,TValue> contains an element with the specified key.

(Inherited from CopySource)
GetEnumerator()

Returns an enumerator that iterates through the collection.

(Inherited from CopySource)
Remove(String)

Removes the element with the specified key from the IDictionary<TKey,TValue>.

(Inherited from CopySource)
TryGetValue(String, Object)

Gets the value associated with the specified key.

(Inherited from CopySource)

Explicit Interface Implementations

ICollection<KeyValuePair<String,Object>>.Add(KeyValuePair<String,Object>)

Adds an item to the ICollection<T>.

(Inherited from CopySource)
ICollection<KeyValuePair<String,Object>>.Clear()

Removes all items from the ICollection<T>.

(Inherited from CopySource)
ICollection<KeyValuePair<String,Object>>.Contains(KeyValuePair<String,Object>)

Determines whether the ICollection<T> contains a specific value.

(Inherited from CopySource)
ICollection<KeyValuePair<String,Object>>.CopyTo(KeyValuePair<String,Object>[], Int32)

Copies the elements of the ICollection<T> to an Array, starting at a particular Array index.

(Inherited from CopySource)
ICollection<KeyValuePair<String,Object>>.Count

Gets the number of elements contained in the ICollection<T>.

(Inherited from CopySource)
ICollection<KeyValuePair<String,Object>>.IsReadOnly

Gets a value indicating whether the ICollection<T> is read-only.

(Inherited from CopySource)
ICollection<KeyValuePair<String,Object>>.Remove(KeyValuePair<String,Object>)

Removes the first occurrence of a specific object from the ICollection<T>.

(Inherited from CopySource)
IEnumerable.GetEnumerator()

Returns an enumerator that iterates through a collection.

(Inherited from CopySource)

Extension Methods

GetValueOrAdd<TKey,TValue>(IDictionary<TKey,TValue>, TKey, Func<TKey,TValue>)

Gets or adds the value associated with specified key.

GetValueOrDefault<TKey,TValue>(IDictionary<TKey,TValue>, TKey, TValue)

Gets the value associated with specified key.

Applies to