question

ThakurTrishla-9180 avatar image
0 Votes"
ThakurTrishla-9180 asked ThakurTrishla-9180 commented

Azure Data Lake directories files went missing after few min of completing the ADF job

Hi Team,

When i execute the ADF pipeline which has set of copy activities and the output file land to this folder structure as shown below

127032-image.png



but the output files got loaded in the location and few min laters the files disappear.

I even downloaded a copy and uploaded the file but even the uploaded files went missing.
This is happening continuously.

As you can see the folder is empty.

Please help me with this issue

azure-data-factoryazure-data-lake-storage
image.png (101.8 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @ThakurTrishla-9180 ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu

0 Votes 0 ·

1 Answer

HimanshuSinha-MSFT avatar image
0 Votes"
HimanshuSinha-MSFT answered ThakurTrishla-9180 commented

Hello @ThakurTrishla-9180 ,
Thanks for the ask and using the Microsoft Q&A platform .

I even downloaded a copy and uploaded the file but even the uploaded files went missing.
This is happening continuously.

This means that some other process is either deleting/moving the files . Please look into logs and you should find some info there .

Thanks
Himanshu


· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Ican u tell me where can i check logs , as per the below image the log folder is also empty

128048-image.png


0 Votes 0 ·
image.png (81.3 KiB)