question

Mike-3952 avatar image
0 Votes"
Mike-3952 asked HarithaMaddi-MSFT answered

Dynamically load dimensions in Azure Synapse SCD Type 1

Hi. I am looking for a dynamic approach to load dimensions in Azure Synapse. I thinking of creating some kind of procedure that will generate merge statements dynamically for each source and target tables. What would be the best approach? please advise

azure-data-factoryazure-synapse-analytics
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

HarithaMaddi-MSFT avatar image
1 Vote"
HarithaMaddi-MSFT answered

Hi @Mike-3952,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

Azure data factory has the UPSERT operation (SCD Type 1) enabled with in-built option in dataflows which is applicable for Azure Synapse as well. Please find below references that will help implement the same. Using foreach activity you can loop through all the source and target tables with config details stored in a metadata table that will help to achieve this dynamically.

data-flow-alter-row
azure-data-factory-mapping-data-flow-for-datawarehouse-etl

Please let us know for further queries and we will be glad to assist.


  • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.