Describe lazy evaluation and other performance features in Azure Databricks

Module
7 Units

Intermediate

Data Engineer

Databricks

Understand the difference between a transform and an action, lazy and eager evaluations, Wide and Narrow transformations, and other optimizations in Azure Databricks.

Learning objectives

In this module, you will:

Describe the difference between eager and lazy execution
Define and identify transformations
Define and identify actions
Describe the fundamentals of how the Catalyst Optimizer works
Differentiate between wide and narrow transformations

Prerequisites

None

Introduction min
Describe the difference between eager and lazy execution min
Describe the fundamentals of how the Catalyst Optimizer works min
Define and identify actions and transformations min
Describe performance enhancements enabled by shuffle operations and Tungsten min
Knowledge check min
Summary min