question

StephensDave-6278 avatar image
0 Votes"
StephensDave-6278 asked PRADEEPCHEEKATLA-MSFT commented

Azure Data Factory Pipeline Duration Metric

Please add the ability to Metrics to show the Pipeline Duration for Azure Data Factories. This would be a key item to diagnosing long runtimes for alerts and dashboards.

Thanks!
Dave

azure-data-factoryazure-metrics-advisor
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @StephensDave-6278,

Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·
PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered PRADEEPCHEEKATLA-MSFT commented

Hello @StephensDave-6278,

Thanks for the question and using the MS Q&A platform.

Unfortunately, Azure Data Factory Pipeline Duration Metric is not available at this moment.

Appreciate if you could share the feedback on our ADF feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

These are the supported metrics available to log in Diagnostic setting:

180558-image.png

For more details, refer to Configure diagnostic settings and a workspace.

Hope this will help. Please let us know if any further queries.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


image.png (85.0 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @StephensDave-6278,

Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.

0 Votes 0 ·
AzureAaronHughes avatar image
1 Vote"
AzureAaronHughes answered

in terms of the copy activity you can use

@activity('Copy Activity').output.copyDuration

in terms of full duration of the pipeline you can use

@pipeline().TriggerTime

and set a end time with the audit collection point - by passing your audit parameters over to a TSQL Proc and used getutcdate() for example to set the end time and cal the duration using the triggertime internal variable

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.