ELT frameworks (Azure)

Question

Generally speaking, which Azure data platform is most typically utilized for data processing in an ELT framework?
Azure Data Factory or Azure Databricks...

Answer 1

Please take a look into this thread https://learn.microsoft.com/en-us/answers/questions/108770/datafactory-vs-databricks.html

Answer 2

Both ADF and Databricks are widely used ETL or ELT solutions.
It depends on the scenarios that must be implemented for the decision-making process.

In the majority of designs, a hybrid approach is employed, which combines ADF with some custom code using Azure databricks or Azure functions/batch ( for some functionalities which are still not available in ADF)

Or, in certain special circumstances when dedicated clusters are required, you choose ADB over ADF, as ADF dataflows construct clusters at runtime with each execution.

ADLA and ADLS will be phased down over the next few years.