Hello,
The copy activity is connected to a dataflow
How is it possible to create a failure activity after the copy activity so that if the copy activity fails, a .parquet file is populated with some error information?
For example
Thank you
Hello,
The copy activity is connected to a dataflow
How is it possible to create a failure activity after the copy activity so that if the copy activity fails, a .parquet file is populated with some error information?
For example
Thank you
Hey,
You can use the below link to dump your error msg in file:
https://docs.microsoft.com/en-us/answers/questions/493585/write-pipeline-variable-value-to-csv-or-text-file.html
using activity('Act_3').error.message

Hi,
Yes, I do have the set variable activity on failure from my copy activity.
Inside the set variable I have placed: @activity('copy activity').Error.Message
Now, I have added one more activity which is now after the set variable activity.
Question:
Inside this copy activity, how can I populate a .parquet file with Error.Message information with a column like ErrorDetails inside the .parquet file?
Thank you
copying variables into file:
https://docs.microsoft.com/en-us/answers/questions/493585/write-pipeline-variable-value-to-csv-or-text-file.html
Yes, I am following that example.
The issue seems to be in my final copy activity which is right after the set variable activity.
What should the source of the copy activity be as it is feeding from the set variable?
Thank you
Hey, the source can be anything as your requirement is to just copy the variable value into the file.
Make sure you delete all mappings of the source in mappings section
6 people are following this question.