We are planning to migrate Apache Airflow to Azure. There are two alternatives: Azure Data Factory and Azure Synapse Analytics (pipelines) I am confused between these.
In brief, we will get data from on premise databases. Then we need to transfer this data into Azure storage. There are two options here two: Azure Blob Storage and Azure Data Lake Storage. I am also confused between these choices. When do we use Blob Storage and when do we use Data Lake Storage. Then we need to ingest the data into SQL Pools(former: Sql Data Warehouse) Then we will run stored procedures for loading data into fact and dimension tables.
In order to create this ETL flow, do we need to use Azure Data Factory or Azure Synapse Analytics (pipelines etc) and why?