question

VishBhanage-8330 avatar image
0 Votes"
VishBhanage-8330 asked Samy-7940 answered

What is best way to move/archive files from one folder to another with a retention of one week in Azure Data lake Gen 2 storage?

On way is Is Copy and Delete Activity in Azure Data factory pipeline?

Or use Azure Data Lake Storage archive tier and is possible to set retention as well with it?

azure-data-factoryazure-data-lake-storage
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

Samy-7940 avatar image
0 Votes"
Samy-7940 answered

Hi @VishBhanage-8330 , If I understand you correctly ,the best practice is to have a layer tiers in Azure Data Lake

GEN2 and have slicing window or time series partitioned that is for example year=2021 month=Sept and so on.

This approach also makes data navigation easier as we could able to locate the required data set quite easily.

Thank you


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.