Copy most recent file only from one blob to another using Azure Data Factory

SHIV 1 Reputation point
2021-02-03T08:56:11.633+00:00

I am trying to copy the most recent file from the set of files with format "filename_yyyymmdd" from one container to another using ADF. I want a single file to be copied from those set of file.

How we can achive this ?

Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,414 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,474 questions
{count} votes

3 answers

Sort by: Most helpful
  1. Nandan Hegde 29,886 Reputation points MVP
    2021-02-03T10:38:28.923+00:00

    Hey @SHIV ,

    https://stackoverflow.com/questions/66014144/copy-most-recent-file-only-from-one-blob-to-another-using-azure-data-factory

    You can refer this link,

    Its a combination of Getmetedata activity and copy activity

    0 comments No comments

  2. Sumarigo-MSFT 43,401 Reputation points Microsoft Employee
    2021-02-04T07:28:05.847+00:00

    @SHIV Welcome to Microsoft Q&A Platform. Thanks for posting the query.

    Adding more information to above suggestion, You can also use different tools: CLI, Azcopy & Azure Storage explorer

    Copy and transform data in Azure Blob storage by using Azure Data Factory

    I would recommended to use the azcopy tool in your scenario.

    There are several options for transferring data to and from Azure, depending on your needs. Please refer to this article

    Hope this helps!

    Kindly let us know if the above helps or you need further assistance on this issue.

    --------------------------------------------------------------------------------------------------------------------

    Please don’t forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments

  3. KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
    2021-04-09T07:38:47.847+00:00

    Hi @@SHIV ,

    You can find the implementation using ADF here : https://learn.microsoft.com/en-us/answers/questions/349584/adf-copy-last-modified-blob.html

    Hope this helps.

    ----------

    Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments