question

RohitKulkarni-3496 avatar image
0 Votes"
RohitKulkarni-3496 asked deherman-MSFT edited

File Transfer between container to another container

Hello Team,

I want to transfer the files from One container(Raw-zone) folder to another container(Staging-zone) specific folder only particular folder need to move like

I want to transfer all the files from folder2 from Raw-zone to Container-zone. How to parameterize this.

Raw-zone(Container)

File Path: Table/Group :

Folder1:File1,File2,File3
Folder2:File,File2,File3
Folder3:File,File2,File3

Staging-zone(Container):

File Path: Table/Group :

Folder1:File1,File2,File3
Folder2:File,File2,File3
Folder3:File,File2,File3

Regards
RK

azure-data-factoryazure-blob-storage
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Have you tried Data factory - copy activity already? You can configure copy activity, create datasets directly to point to folder2 in source and target container.

0 Votes 0 ·

I am using the copy activity in ADF.That's the problem i can't do static choice for the folder.

The user want to be parametrized any time he may give folder1 or folder2 or folder 3 or both(Folder2 and folder3)

Thanks in advance

RK

0 Votes 0 ·

1 Answer

VaibhavChaudhari avatar image
0 Votes"
VaibhavChaudhari answered VaibhavChaudhari edited
  1. Create four parameters at pipeline level - source container & folder path and same for target

  2. Parameterize datasets and feed above parameters to it

  3. When you run the pipeline, you put the source & target details


78825-image.png




Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav


image.png (53.8 KiB)
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

I have given the the same format parameter and even i given another parameter for Path of the folder. Still it is taking all the 3 folder and getting copied.

And one more think i wanted to bring it notification. This is not a direct pipeline. It is linked with another output to this copy folder pipeline.

0 Votes 0 ·

Probably paths are not being mapped correctly when you pass it from previous pipeline/activity to the copy activity. You need to debug the pipeline, check input / output values (as shown in screenshot) and see where you get the wrong path

78891-image.png


0 Votes 0 ·
image.png (21.4 KiB)