question

KothaiRamanathan-7384 avatar image
0 Votes"
KothaiRamanathan-7384 asked ·

Validation Activity - Not giving right error

I have a pipeline which works on files in a folder. At the start of the pipeline is a validate activity to check if files exist. If there are no files, then we do nothing. Because we do not want the pipeline to report an error every time there are no files. As files not being present in a valid business scenario.

However notice that if there are other failures in the validation activity (either the path provided is not right, or the credentials provided are not right), even then it only fails the activity, but not give the error for which it failed.

69909-image.png

In the above scenario, I have provided a wrong directory name, and the activity failed, but there is no error that the parameter is wrong. If I do the same thing to a copy activity, it rightly provides an error mentioning that the parameter is wrong.

Because of this, we are not able to identity whether the activity failed because of files not found, or there was real issue when accessing the files. How do we differentiate such cases ?

azure-data-factory
image.png (47.9 KiB)
· 4
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

To add to the above, if on the failure of the validation activity, I say "@coalesce(activity('Validate if files exist').Error.Message, '')" , it gives an empty string.

0 Votes 0 ·
KranthiPakala-MSFT avatar image KranthiPakala-MSFT KothaiRamanathan-7384 ·

Hi @KothaiRamanathan-7384,

Thanks for bringing this to our notice. Could you please share the error message (inappropriate error) your are receiving?

Thank you



Announcement : Want to participate in Azure Data Factory hackathon'21? Come hack with us :) - https://aka.ms/adfhack21 (Note: Submission Deadline 24th Feb'21)

0 Votes 0 ·

@KranthiPakala-MSFT - as shown in the screenshot above, it is not giving any error message. The activity failed, but there is no error message.

0 Votes 0 ·
Show more comments

0 Answers