question

bk-4602 avatar image
0 Votes"
bk-4602 asked VarshabenNannulalAhirwalMINDTREELI-3967 answered

Retry pipelines

Hi All i have some of my data pipelines failing because of network errors. I went to the activity and selected retry and time in seconds. My question is , i want to make sure these retries happen only when the pipe line fails and not when it is a success. Can someone please confirm,
Thanks

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

VaibhavChaudhari avatar image
1 Vote"
VaibhavChaudhari answered AnaRitaBorregoTIMESTAMP-4239 commented

Yes, your understanding is correct. If the activity fails, the retry attempt happens. If pipeline is successful, this retry setting is ignored in success case

Reference - https://docs.microsoft.com/en-us/azure/data-factory/copy-activity-overview#resume-from-last-failed-run

Activity level retry: You can set retry count on copy activity. During the pipeline execution, if this copy activity run fails, the next automatic retry will start


Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

What would happen if you set activity level retry on an activity in a for each loop. Would that exact iteration of the activity be retried with the parameters from that iteration?

1 Vote 1 ·

Do we have an answer for this question? Is actually an interesting and important question regarding the retry option.

0 Votes 0 ·
22419291 avatar image
0 Votes"
22419291 answered

@VaibhavChaudhari

How about pipeline hanging for a log time? (e.g. if it takes more than 1hr, it needs to be restarted)
Can I use "if condition", "until" some flow control activities to deal with it?

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

VarshabenNannulalAhirwalMINDTREELI-3967 avatar image
0 Votes"
VarshabenNannulalAhirwalMINDTREELI-3967 answered

@VaibhavChaudhari Any solution for pipeline hanging for a long time?

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.