Feedback Edit

SparkSessionOptions Class

  • Reference

SparkSessionOptions.

All required parameters must be populated in order to send to Azure.

Inheritance
Model
SparkSessionOptions

Constructor

SparkSessionOptions(*, name: str, tags: Optional[Dict[str, str]] = None, artifact_id: Optional[str] = None, file: Optional[str] = None, class_name: Optional[str] = None, arguments: Optional[List[str]] = None, jars: Optional[List[str]] = None, python_files: Optional[List[str]] = None, files: Optional[List[str]] = None, archives: Optional[List[str]] = None, configuration: Optional[Dict[str, str]] = None, driver_memory: Optional[str] = None, driver_cores: Optional[int] = None, executor_memory: Optional[str] = None, executor_cores: Optional[int] = None, executor_count: Optional[int] = None, **kwargs)

Parameters

tags
dict[str, str]
Required

A set of tags. Dictionary of <string>.

artifact_id
str
Required
name
str
Required

Required.

file
str
Required
class_name
str
Required
arguments
list[str]
Required
jars
list[str]
Required
python_files
list[str]
Required
files
list[str]
Required
archives
list[str]
Required
configuration
dict[str, str]
Required

Dictionary of <string>.

driver_memory
str
Required
driver_cores
int
Required
executor_memory
str
Required
executor_cores
int
Required
executor_count
int
Required