dataflow sink cash

arkiboys 9,621 Reputation points
2021-09-20T12:01:52.737+00:00

Hi,
once I am done with the dataflow (source, filter, select, etc...sink)
I then would like to use the whole dataset (Columns and rows) and loop through each inside a foreach activity.
How is this done?
Note that I want to loop through all the items from the sink in dataflow
Is there something like, @activity('Filter1').output.value I should be using?

Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,531 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 37,896 Reputation points Microsoft Employee
    2021-09-21T07:24:29.21+00:00

    Hi @arkiboys ,

    Thank you for posting query here.

    You can achieve this using Sink transformation - "write to activity output setting". Note, you need to remove First row only selection from Data flow activity sink properties.

    Below are the detailed steps with screenshots. Kindy check them.

    Step1: Sink Transformation - select "write to activity output setting"

    133892-image.png

    Step2: Dataflow activity in pipeline. Remove first row only selection

    133856-image.png

    Step3: Pass your "value array"(which contains your sink data) to ForEach activity to iterate over your data.
    expression used: @activity('<dataflow activity name>').output.runStatus.output.sink1.value

    133893-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    0 comments No comments

0 additional answers

Sort by: Most helpful