question

Kira-22 avatar image
0 Votes"
Kira-22 asked SumanthMarigowda-MSFT edited

looping through files and copy data in Azure data factory

hello,

I am trying to copy folders with their files from ftp into an azure data storage, by looping through the folders and for each folder copy the content into a container that has the folder's name. for this, I used a metadata ,for each and copy data component. For now I am able to copy all the folders into the same container , but what I want is to have multiple containers named after the the folders in the output, each one containing files from the ftp.

ps : I am still new to azure data factory

Any advise or help is very welcome :)

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

jhueppauff avatar image
0 Votes"
jhueppauff answered jhueppauff commented
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thanks for your response, yes its exactly what I did. it does copy the folders but they are put in the same container. my issue is that I want each folder to be copied in a container.
II set the container's value dynamically as Item.name(), so that the containers will have the folders names but it returs this error :

ErrorCode=UserErrorFailedToCreateAzureBlobContainer,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Unable to create Azure Blob container. Endpoint: https://testdatafactory.blob.core.windows.net/, Container Name: file_119.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.WindowsAzure.Storage.StorageException,Message=The remote server returned an error: (400) Bad Request.,Source=Microsoft.WindowsAzure.Storage,StorageExtendedMessage=RequestId:6b893a70-b01e-00b8-5d98-9584b1000000 Time:Fri, 20 Aug 2021 07:53:20 GMT,,''Type=System.Net.WebException,Message=The remote server returned an error: (400) Bad Request.,Source=System,'




PS : I'm new to azure data factory

0 Votes 0 ·

Bad Request 400 means you request is invalid:
I assume your container name is file_119? You can only use lowercase letter, numbers and hyphens for container names.

Try using file-119 as name instead for example.

0 Votes 0 ·