question

YonatanGrinberg-9510 avatar image
0 Votes"
YonatanGrinberg-9510 asked ShaikMaheer-MSFT commented

Documenting Data Factory Pipelines

Hi,

While defining documentation aspects on pipelines (mostly from on premise databases to azure synapse via data factory pipelines).
Looking for best practice suggestions on documenting pipelines and synapse sql stored procedures.

My team is currently using a network folder but thinking of using azure devops wiki.

Was wondering if there is some better way to link the pipeline to the corresponding documentation so that you could access it from a link within the data factory graphical modeling UI.

azure-data-factoryazure-synapse-analytics
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @YonatanGrinberg-9510 ,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

1 Vote 1 ·

1 Answer

VaibhavChaudhari avatar image
1 Vote"
VaibhavChaudhari answered

DevOps Wiki would be good place where you can document the pipeline details manually and provide links to the ADF.

There is Azure Purview service as well which can help you with data lineage which shows what data is flowing where.

https://docs.microsoft.com/en-us/azure/purview/how-to-link-azure-data-factory#supported-lineage-patterns


Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.