question

arkiboys avatar image
0 Votes"
arkiboys asked ShaikMaheer-MSFT commented

dataflow sink cash

Hi,
once I am done with the dataflow (source, filter, select, etc...sink)
I then would like to use the whole dataset (Columns and rows) and loop through each inside a foreach activity.
How is this done?
Note that I want to loop through all the items from the sink in dataflow
Is there something like, @activity('Filter1').output.value I should be using?

Thank you

azure-data-factory
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @arkiboys ,

Just checking in to see if the above answer helped. If this answers your query, do click 130616-image.png and upvote 130671-image.png for the same. And, if you have any further query do let us know.

0 Votes 0 ·

1 Answer

ShaikMaheer-MSFT avatar image
0 Votes"
ShaikMaheer-MSFT answered

Hi @arkiboys ,

Thank you for posting query here.

You can achieve this using Sink transformation - "write to activity output setting". Note, you need to remove First row only selection from Data flow activity sink properties.

Below are the detailed steps with screenshots. Kindy check them.

Step1: Sink Transformation - select "write to activity output setting"

133892-image.png

Step2: Dataflow activity in pipeline. Remove first row only selection

133856-image.png

Step3: Pass your "value array"(which contains your sink data) to ForEach activity to iterate over your data.
expression used: @activity('<dataflow activity name>').output.runStatus.output.sink1.value

133893-image.png

Hope this will help. Please let us know if any further queries.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators


image.png (135.3 KiB)
image.png (133.5 KiB)
image.png (62.2 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.