Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline

Intermediate
Data Engineer
Data Scientist
Azure Data Factory
Azure Synapse Analytics

In this module, you will learn how Azure Data Factory can orchestrate large scale data movement by using other Azure Data Platform and Machine Learning technologies.

Learning objectives

  • Introduction
  • Understand data factory control flow
  • Work with data factory pipelines
  • Debug data factory pipelines
  • Add parameters to data factory components
  • Integrate a Notebook within Azure Synapse Pipelines
  • Execute data factory packages
  • Knowledge check
  • Summary

Prerequisites

The student should be able to:

  • Log into the Azure portal
  • Explain and create resource groups
  • Describe Azure Data Factory and it's core components
  • Ingest data into Azure Data Factory using the Copy Activity