question

SunnySoni-3595 avatar image
0 Votes"
SunnySoni-3595 asked SunnySoni-3595 commented

Web Activity Not timing out

Hi Team,

We have a web activity that is calling a REST API , It is using post and pushing the data.


The web activity is in a for each loop and running as batch with 50 batch count, The problem we are facing is that the WEB ACTVITY is not timing out and even running for 40mins even if we set the timeout as 10 seconds .

Regards

azure-data-factory
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@SunnySoni-3595 we haven't heard back from you. If you are still facing the issue, please share what the timeout and retry settings on the web activity are.

0 Votes 0 ·

@SunnySoni-3595 if you found your own solution, could you please share with the community?

0 Votes 0 ·
HimanshuSinha-MSFT avatar image
0 Votes"
HimanshuSinha-MSFT answered SunnySoni-3595 commented

Hello @SunnySoni-3595 ,
Thanks for the ask and using the Microsoft Q&A platform .
The timeout value for Webactivity is set to 1 min and at this time it not configurable .
https://docs.microsoft.com/en-us/azure/data-factory/control-flow-web-activity

So in your case it 10 sec is not a valid use case . You wrote that the activity was still running for 40 mins , I am just curiuos as to what is is the behaviour do you see when you run the same using curl or postman ?

There are others users who are demanding to make this parameter configurable . May I request you to please log the same here .Product group does monitor the request and they can plan for the implementation in future .Once you log the feature request you will also be notified on the status of the request .


95391-image.png


Please do let me know how it goes .
Thanks
Himanshu
Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members



image.png (32.0 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Seems that web activity was getting response within 10 sec, but it was running in foreach loop batch , it was getting delayed due to another activity which was slow or stuck.

0 Votes 0 ·
MartinJaffer-MSFT avatar image
0 Votes"
MartinJaffer-MSFT answered SunnySoni-3595 commented

Hello @SunnySoni-3595 .

About a year ago, I stumbled across something that seemed to break the web activity timeout. I'm not sure if it is still applicable now. Back then, I caused it by:

Setting the Authentication method to MSI,
And setting the resource as "https://storage.azure.com/.default"

Did something like this happen for you? Could you give us a few details about the web activity so we can attempt to reproduce the issue?

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

I just tested. The break I found a year ago either was a misconception on my part, or it was fixed.

0 Votes 0 ·

Thanks for the comments

0 Votes 0 ·
SunnySoni-3595 avatar image
0 Votes"
SunnySoni-3595 answered

The web activity was taking even 15 mins to run as I believe it was in foreach loop running in parallel and that was delaying, I had to reduce the for each loop batch count so other activities dont wait for prior activity.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.