SparkSection Class

Defines Spark settings to use for the PySpark framework in the environment.

This SparkSection class is used in the Environment class.

Class SparkSection constructor.

Inheritance
azureml._base_sdk_common.abstract_run_config_element._AbstractRunConfigElement
SparkSection

Constructor

SparkSection(**kwargs)

Variables

Name Description
repositories

A list of Spark repositories.

packages

The packages to use.

precache_packages

Indicates Whether to precache the packages.