Share via

Batching file i want to write in single file

Rashid Iqbal 1 Reputation point
2020-10-14T10:31:49.127+00:00

Suppose we have 10k entities in JSON and i want to publish any target location then i can achieve them through batching and i will get multiple files in target location but my question is that while batching i am getting batch file with batch size entities value and trying to write into a single file in azure blob .

Do we have ability to write multiple file entities into a single file of Azure blob.

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,809 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,534 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. deherman-MSFT 34,356 Reputation points Microsoft Employee
    2020-10-15T18:56:11.9+00:00

    @Rashid Iqbal Apologies for the delayed response here and any inconvenience it might have caused.

    One option that might work for you is using Azure Data Factory. For copy activity you can merge the files using blob storage as the destination. There is a property called MergeFiles which can be specified for copyBehavior and this will merge all the files from the source folder to one file.

    Hope this helps! Let us know if you have further questions or issues and we will be happy to assist.

    -------------

    Please don’t forget to "Accept the answer" and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    0 comments