question

arkiboys avatar image
0 Votes"
arkiboys asked arkiboys commented

failure activity

Hello,
The copy activity is connected to a dataflow
How is it possible to create a failure activity after the copy activity so that if the copy activity fails, a .parquet file is populated with some error information?
For example
Thank you

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

NandanHegde-7720 avatar image
0 Votes"
NandanHegde-7720 answered arkiboys commented

Hey,
You can use the below link to dump your error msg in file:
https://docs.microsoft.com/en-us/answers/questions/493585/write-pipeline-variable-value-to-csv-or-text-file.html

using activity('Act_3').error.message


121079-err.png



err.png (15.8 KiB)
· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi,
Yes, I do have the set variable activity on failure from my copy activity.
Inside the set variable I have placed: @activity('copy activity').Error.Message

Now, I have added one more activity which is now after the set variable activity.
Question:
Inside this copy activity, how can I populate a .parquet file with Error.Message information with a column like ErrorDetails inside the .parquet file?

Thank you

0 Votes 0 ·

Yes, I am following that example.
The issue seems to be in my final copy activity which is right after the set variable activity.
What should the source of the copy activity be as it is feeding from the set variable?
Thank you

0 Votes 0 ·

Hey, the source can be anything as your requirement is to just copy the variable value into the file.

Make sure you delete all mappings of the source in mappings section

0 Votes 0 ·