question

Mike2020-4814 avatar image
0 Votes"
Mike2020-4814 asked Mike2020-4814 commented

ADF : Clarity on Lookup Activity Timeout values with SQL

Hi

In Azure Data Factory, we have a lookup activity with an SQL Database.

There are config items on the general tab of the activity for timeout/retry/retry interval.

In the settings tab, there is a "Query timeout (minutes)" config item.


Can we have some clarity on the two timeout please and best practice? For example, one would assume it is best practice to set the "Query timeout (minutes)" to be lower than the activity timeout value?

We would like to ensure that your basic sql query timeout get handled correctly with opportunity to retry according to the retry config items against the activity.

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

KranthiPakala-MSFT avatar image
1 Vote"
KranthiPakala-MSFT answered Mike2020-4814 commented

Hi @Mike2020-4814,

Welcome to Microsoft Q&A forum and thanks for reaching.

Sorry for the delay in response. As called out in the lookup activity documentation, the maximum amount of time a lookup activity can run before timeout is 24hrs. This 24 hours timeout limit is at lookup activity level. For some types of dataset (like SQL), you can specify queryTimeout, which takes effect on the query. This timeout won't be effective if it is greater than lookup activity timeout (24hrs).

77046-image.png

As a best practice it is better to set the queryTimeout value lower than the lookup activity timeout value. And yes, in case if your SQL query timeout for some reason, you can utilize the Retry (maximum number of retry attempts before lookup activity status reported as failed) and Retry Interval (the number of seconds between each retry attempt of the activity) properties as needed to avoid activity/pipeline failures.

Hope this info helps. Do let us know if you have further query.



Thank you
Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.



image.png (29.9 KiB)
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @Mike2020-4814,

Following up to see if the above information was helpful? Do let us know if you have further query.

Thanks

0 Votes 0 ·

Hi @Mike2020-4814,

We still have not heard back from you. Just wanted to check if the above info was helpful? Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.

And if you have further query, do let us know.

Thanks

0 Votes 0 ·

Hi

Thanks - yes very helpful and certainly clarifies things.

0 Votes 0 ·