Describe lazy evaluation and other performance features in Azure Databricks

Intermediate
Data Engineer
Databricks

Understand the difference between a transform and an action, lazy and eager evaluations, Wide and Narrow transformations, and other optimizations in Azure Databricks.

Learning objectives

In this module, you will:

  • Describe the difference between eager and lazy execution
  • Define and identify transformations
  • Define and identify actions
  • Describe the fundamentals of how the Catalyst Optimizer works
  • Differentiate between wide and narrow transformations

Prerequisites

None