what will happen when you try to copy a file from SFTP to ADLS in Azure data factory while huge file still in SFTP transit. Will pipeline error out with appropriate error msg or still file be partially copied to ADLS.
what will happen when you try to copy a file from SFTP to ADLS in Azure data factory while huge file still in SFTP transit. Will pipeline error out with appropriate error msg or still file be partially copied to ADLS.
Hi anonymous user,
Thanks for reaching out.
When you encounter an error while copying from SFTP to ADLS using Azure Data Factory, then below is the expected behavior:
File level: ADF will delete the incomplete file from sink/target if encounter error.
Folder level: ADF only deletes incomplete files in target/sink, files copied successfully will remain in the sink folder.
Hope this clarifies.
Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.
4 people are following this question.