question

ks567 avatar image
0 Votes"
ks567 asked KranthiPakala-MSFT answered

Will accessing SFTP file error out when file is in transist

what will happen when you try to copy a file from SFTP to ADLS in Azure data factory while huge file still in SFTP transit. Will pipeline error out with appropriate error msg or still file be partially copied to ADLS.

azure-data-factoryazure-data-lake-storage
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered

Hi anonymous user,

Thanks for reaching out.

When you encounter an error while copying from SFTP to ADLS using Azure Data Factory, then below is the expected behavior:

  1. File level: ADF will delete the incomplete file from sink/target if encounter error.

  2. Folder level: ADF only deletes incomplete files in target/sink, files copied successfully will remain in the sink folder.


Hope this clarifies.



Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.