Hello Everybody,
I'm running a project where we need to propose an azure-based architecture to import data from an on-premises data warehouse (databases) to azure-based data platform.
Data are aimed to be exposed to company operators through a web visualization UI (with some analytics capabilities).
Data needs to be captured from on-premises, transformed from RAW to daily curated and exposed to end-user, using vizualisation tool.
I need your opinions to discuss benefits of using each of below services:
Azure Databricks OR Azure Synapsis Analytics OR Azure HD insight
Azure Analysis services
Azure SQL Database OR Azure Cosmos DB
Azure Data Factory OR Azure Data Migration Assistant
Azure Data Lake OR Azure Blob Storage
Here some constraints:
As compliance with modularity and service segregation principles, we need to separate jobs into different nodes.
Data migration will be performed by Azure Data Factory, but I need to know if Azure Data Migration assistant is also suitable in this case ?
Data should be stored in a resource that permit transformation, is Data Lake the best answer for this ?
For data transformation jobs from RAM to daily curated, would Databricks be the best solution for this ?
Would Azure Analysis Services be the best azure tool to interface with end-user visualization UI to perform some analytics ?
