question

balaa-uk avatar image
0 Votes"
balaa-uk asked SaurabhSharma-msft commented

Does Copy activity failure, rollback entire dataset?

Copying huge dataset with Copy activity with 'Skip incompatible rows' and logging enabled to capture failed rows and mark them retry during next run. When I Encountered Transport/Remote host closed connection error, it did not write any row specific details to logs. The question is when such a failure happens, does it rollback entire dataset?

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SaurabhSharma-msft avatar image
0 Votes"
SaurabhSharma-msft answered SaurabhSharma-msft commented

@balaa-uk Thanks for using Microsoft Q&A !!

Unfortunately, Azure Data Factory does not have any in built transactions logic to rollback the entire data set. You need to create custom logic to achieve the same. You can refer to these two threads for your reference and implementation purpose -

Please let me know if you have any other questions.


Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@balaa-uk Please let me know if you find above reply useful. If yes, do click on 'Mark as answer' link in above reply. This will help other community members facing similar query to refer to this solution. Thanks.

0 Votes 0 ·

@balaa-uk I have not heard back from you. Did my answer solve your issue? If so, please mark as accepted answer. If not, please let me know how I may better assist.

0 Votes 0 ·