SparkSection Class

Defines Spark settings to use for the PySpark framework in the environment.

This SparkSection class is used in the Environment class.

Class SparkSection constructor.

Inheritance
azureml._base_sdk_common.abstract_run_config_element._AbstractRunConfigElement
SparkSection

Constructor

SparkSection(**kwargs)

Variables

repositories
list

A list of Spark repositories.

packages
list

The packages to use.

precache_packages
bool

Indicates Whether to precache the packages.