Integrate SQL and Apache Spark pools in Azure Synapse Analytics

Intermediate
Data Engineer
Synapse Analytics

Learn how to integrate SQL and Apache Spark pools in Azure Synapse Analytics.

Learning objectives

After completing this module, you will be able to:

  • Describe the integration methods between SQL and Spark Pools in Azure Synapse Analytics
  • Understand the use-cases for SQL and Spark Pools integration
  • Authenticate in Azure Synapse Analytics
  • Transfer data between SQL and Spark Pool in Azure Synapse Analytics
  • Authenticate between Spark and SQL Pool in Azure Synapse Analytics
  • Integrate SQL and Spark Pools in Azure Synapse Analytics
  • Externalize the use of Spark Pools within Azure Synapse workspace
  • Transfer data outside the Synapse workspace using SQL Authentication
  • Transfer data outside the Synapse workspace using the PySpark Connector
  • Transform data in Apache Spark and write back to SQL Pool in Azure Synapse Analytics

Prerequisites

Before taking this module, it is recommended that you complete the following modules:

  • Data Fundamentals
  • Introduction to Azure Data Factory
  • Introduction to Azure Synapse Analytics