ADF For each with until activity

Vikas Tiwari 766

I have 6 different API details as rows in sql watermark table and using foreach to iterates over these 6 rows and copy data from source to destination using ADF pipeline.

Now, I need to split data into different files and each file will have 2000 records, for this I have tried until activity and its working fine standalone but unable to find way where I can use until activity inside foreach loop.

Basically I am looking to find a way, foreach -> 1st iteration (call 1st API)-> get the data and split using until activity -> 2nd iteration (call 2nd API)->get the data and split using until activity .... upto 6 iteration.

Is it possible to use until activity under foreach loop?

Shreyasi Srivastava 21 Reputation points

2022-05-05T17:27:34.743+00:00

Hi Vikas,
Could you please share the snapshot of your pipelines for for each and until activity pipelines, I have the same issue and I am not able to understand how to pass parameter as value to the datasets in different pipelines

Accepted answer

Nandan Hegde 29,891 Reputation points MVP

2022-01-20T05:32:33.657+00:00

Hey,
You can call excute pipeline activity within for each activity.
So you can add the untill logic in another pipeline and call that pipeline within foreach
Please sign in to rate this answer.
Vikas Tiwari 766 Reputation points

2022-01-24T05:23:23.637+00:00

Thanks @Nandan Hegde . Do you also if we can pass variable across the pipelines?

I have tried to set variable in main pipeline but its not showing in child pipeline to use it.

Nandan Hegde 29,891 Reputation points MVP

2022-01-24T08:13:39.96+00:00

Hey,
you need to pass the variable value of 1st pipeline as parameter to another pipeline in order to use it..

https://learn.microsoft.com/en-us/answers/questions/175485/passing-parameters-in-the-execute-pipeline-activit.html

Please accept it as answer in case if helped as it might benefit other community members as well

Vikas Tiwari 766 Reputation points

2022-01-24T18:01:58.023+00:00

Thanks it worked as expected.

Shreyasi Srivastava 21 Reputation points

2022-05-05T17:40:54.377+00:00

Hi if I have pipeline parameter set in for each activity named relative url which has array of relative url as value that I need to pass as value for dataset parameter inside copydata which is the part of until activity, how can I achieve that?

This is inside until activity.
Sign in to comment

ADF For each with until activity

0 additional answers