question

ewinkiser avatar image
0 Votes"
ewinkiser asked ShaikMaheer-MSFT commented

ADF Passing a filename to use as a DS in an Execute pipeline?

@nasreen-akter @MartinJaffer-MSFT @KranthiPakala-MSFT

Ok, to fix a bug in PROD now I have to launch a special pipeline to perform an action. Ok, I know I can pass a JSON filename successFactors_employee_deltas_20210610011046.json for example to the child pipeline. But I need to use this filename as a dataset in a COPY Activity, please see below. It should be easy but I can't get this to work. How do I substitute the file in the dataset with the file name that has been passed from the parent pipeline. In a real bind here; to set up a design is much easy than implementing it lol Thanks! Mike KIser



105984-screenshot-2021-06-15-193618.jpg105943-screenshot-2021-06-15-193812.jpg


azure-data-factory
· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @ewinkiser ,

Just checking in to see if the below answer provided by @NandanHegde-7720 helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.
 

0 Votes 0 ·

Hi @ewinkiser ,

Just checking in to see if the below answers provided by @NandanHegde-7720 or @ShaikMaheer-MSFT helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·

Hi @ewinkiser ,

Just checking in to see if the below answers provided by @NandanHegde-7720 or @ShaikMaheer-MSFT helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·

Hey @ewinkiser,

Following up to check is below answers helped you. If yes, please accept an answer. Thank you

0 Votes 0 ·
NandanHegde-7720 avatar image
1 Vote"
NandanHegde-7720 answered ShaikMaheer-MSFT commented

Hey @ewinkiser,

You need to follow the below steps:
1) create a dataset parameter
2) Create a Pipeline parameter

So the flow would be:

Parent Pipeline >> file name >> execute pipeline parameter >> file name >>> dataset parameter

Hope this helps. Do let us know if you any further queries.


Please "Accept the answer" if the information helped you. This will help us and others in the community as well.

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @ewinkiser ,

Just checking in to see if the below answer provided by @NandanHegde-7720 helped.

If this answers your query, do click Accept Answer and Up-Vote for the same.

And, if you have any further query or further clarification please do let us know. We will be happy to help. Thank you

0 Votes 0 ·
ShaikMaheer-MSFT avatar image
0 Votes"
ShaikMaheer-MSFT answered

Hi @ewinkiser ,

Hi @ewinkiser ,

Thank you for posting query. Please check below detailed implementation to know how to pass filename to Dataset.

Step1: Create a dataset with parameter(FileName) in it to accept value dynamically.

107537-dataset.gif

Step2: Create a child pipeline with a FileName parameter in it. And, in copy activity use above created dataset and pass pipeline parameter in to copy activity dataset parameter.

107480-childpipeline.gif

Step3: Create a parent pipeline and use Execute pipeline activity in it to run child pipeline. Inside Execute pipeline activity, you will be asked to supply value for FileName Parameter which you created in child pipeline.

107447-parentpipeline.gif

Hope this will help. Thank you.


  • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

  • Want a reminder to come back and check responses? Here is how to subscribe to a email-notifications


dataset.gif (423.0 KiB)
childpipeline.gif (604.8 KiB)
parentpipeline.gif (293.1 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.