question

MadhuBalan-1479 avatar image
0 Votes"
MadhuBalan-1479 asked MadhuBalan-1479 commented

Looping the Lookup activty's output using a For each activity is taking longer time than expected.

I had a web service which accepts http post requests and returns some XML data. The input for the POST request is in my SQL table. So, I've used a lookup activity followed by a for each activity which loops the look-up activity's output to get my desired xml data from web-service. This is taking a performance hit as each webservice request taking more than 30 seconds. But in my SOAP UI, the same request is taking only ~300 milliseconds to retrieve the data. Help me with the suggestions !!

azure-data-factory
· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @MadhuBalan-1479 ,
Thanks for the ask and using the Microsoft Q&A platform .

Are the ADF and the webservice in the same region ? Is the WS hosted locally and you are using SHIR to connect to that ?

Please do let me know how it goes .
Thanks
Himanshu
Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

0 Votes 0 ·

Hi @HimanshuSinha-MSFT. The webservice is hosted in a Azure VM. Both Azure VM and ADF are in same region and i'm using SHIR to connect to the service. Please let me know if you need more details.

0 Votes 0 ·

Hello @MadhuBalan-1479 ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu

0 Votes 0 ·

Hello @MadhuBalan-1479 ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu

0 Votes 0 ·

0 Answers