Logic App not able to deserialized Azure data factory pipeline error message

HemantSudehely-0557 261

Hi,

I am facing the below issue with Azure Data Factory using Logic App.

I am using the Azure Data Factory pipeline for migration and Logic App for sending "Success & Failure" notification to the technical team.
Now success is working fine as the message is hardcoded, but failure is not as the Logic App web activity is not able to parse data factory pipeline error.

Here is the input that is going to Logic App web activity
Input
{
"url": "https://xxxxxxxxxxxxxxxxx",
"method": "POST",
"headers": {},
"body": "{\n \"title\": \"PIPELINE RUN FAILED\",\n \"message\":\"Operation on target Migration Validation failed: Execution fail against sql server. Sql error number: 50000. Error Message: The DELETE statement conflicted with the REFERENCE constraint \"FK_cmclientapprovedproducts_cmlinkclientchannel\". The conflict occurred in database \"Core7\", table \"dbo.cmClientApprovedProducts\", column 'linkclientchannelid'.\",\n \"color\": \"Red\",\n \"dataFactoryName\": \"LFC-TO-MCP-ADF\",\n \"pipelineName\": \"LFC TO MCP MIGRATION\",\n \"pipelineRunId\": \"f4f84365-58f0-4da1-aa00-64c3a4daa9e1\",\n \"time\": \"2020-07-31T22:44:01.6477435Z\"\n}"
}

Here is the error logic app is throwing

failures
{
"errorCode": "2108",
"message": "{\"error\":{\"code\":\"InvalidRequestContent\",\"message\":\"The request content is not valid and could not be deserialized: 'After parsing a value an unexpected character was encountered: F. Path 'message', line 3, position 202.'.\"}}",
"failureType": "UserError",
"target": "Send Failed Notification",
"details": []
}

I have tried various options, like set variable and convert by using various existing methods (string, json, replace etc), but no luck
e.g @ hide (activity('LOS migration').Error.Message)
Struggling almost all day this...please suggest if anyone faced a similar issue...

Below is the data flow activity

Accepted answer

HarithaMaddi-MSFT 10,126 Reputation points

2020-08-03T08:59:13.11+00:00

Hi @HemantSudehely-0557,

Welcome to Microsoft Q&A Platform.

Below is an approach I used to get dynamic error messages in mail using Logic App from Azure Data Factory, it worked. If the issue persists, please share your pipeline run id to investigate further.
Please sign in to rate this answer.

1 person found this answer helpful.
HemantSudehely-0557 261 Reputation points

2020-08-03T14:00:38.42+00:00

Hi Haritha,

I am using the same approach but still the same issue, the logic app is not able to parse the error message.

Pipeline run id is - "243b0761-c94f-4043-bab6-a94c950aa9de"

Please help...

Here is the JSON body That is going to Logic APP

HemantSudehely-0557 261 Reputation points

2020-08-03T19:08:10.187+00:00

Is there any update on this issue?

HarithaMaddi-MSFT 10,126 Reputation points

2020-08-04T05:18:08.487+00:00

Hi @HemantSudehely-0557 ,

Thanks for sharing the details. I am working with product team to get more insights on the issue and will update you once I hear back from them. Meanwhile, if not already tried, can you please check removing response activity in your pipeline and directly passing error message in Logic App as "@{activity('LOS migration').Error.Message}".

HemantSudehely-0557 261 Reputation points

2020-08-04T14:09:30.883+00:00

I have already tried without response bypassing pipeline error message but still the same issue.

failures
{
"errorCode": "2108",
"message": "{\"error\":{\"code\":\"InvalidRequestContent\",\"message\":\"The request content is not valid and could not be deserialized: 'After parsing a value an unexpected character was encountered: F. Path 'message', line 3, position 202.'.\"}}",
"failureType": "UserError",
"target": "Send Failed Notification",
"details": []
}

HarithaMaddi-MSFT 10,126 Reputation points

2020-08-04T14:44:32.027+00:00

Hi @HemantSudehely-0557 ,

Thanks for confirming the issue again. I have seen past issues from customers on Logic App with similar error and below is one possible solution - Please try pasting your body content into the body text field box WITHOUT clicking on 'Add Dynamic Content' in web activity calling Logic App. Even I did not use dynamic content in the GIF I shared above. Please let us know if this is working!

HemantSudehely-0557 261 Reputation points

2020-08-04T23:07:41.09+00:00

Yes, now it is working...Thanks for providing an alternate option!!!
"pasting body content into the body text field box WITHOUT clicking on 'Add Dynamic Content' in web activity calling Logic App. "

HarithaMaddi-MSFT 10,126 Reputation points

2020-08-05T05:04:39.19+00:00

Thanks for confirming the solution. Glad that it helped.

Ashish Kumar 1 Reputation point

2020-09-11T18:47:53.447+00:00

I am also getting the same error message.

Ashish Kumar 1 Reputation point

2020-09-12T05:33:39.173+00:00

Hi Haritha,

Can you please let us know, what is the reason behind that if we use dynamic content it is not working instead of pasting the same on body, its working.

Is there any bug in Web activity?

HarithaMaddi-MSFT 10,126 Reputation points

2020-10-14T05:17:28.79+00:00

Apologies @Ashish Kumar for the delay in response.

I reached out to product team for more insights on it and will get back to you once I have the details from them.

HarithaMaddi-MSFT 10,126 Reputation points

2020-10-15T14:13:20.993+00:00

Hi @Ashish Kumar ,

I received update from Product team that when using dynamic content we need to pass additional double quotes to indicate that the parameter should be read as string as below. If parameter is a string we can also use string function instead of double quotes.

{"DataFactoryName":"@{pipeline().DataFactory}","ErrorMessage":"@{activity('Copy data').output.errors}"}

Highlighted quotes in below snap

Please check and let us know if you are still facing the issue. Thanks for your patience!
Sign in to comment

2 additional answers

Mark Zhukovsky 46 Reputation points

2021-03-13T19:51:40.147+00:00
For those coming here struggling with this terrible problem as I have for way longer than desired; for my case, I have found the solution, and I suspect it will work for many others.

The answer lies in the content of the JSON - if what you are passing in has DOUBLE QUOTES, they need to be replaced with SINGLE quotes. It is the only thing that worked for me.

E.g.:

@string(replace(activity('Execute a failing Pipeline').error.message, '"',''''))

Note that these look identical because the first one is a double quote (what we are replacing) within single quotes, and the second one (what we are replacing it with) is an escaped single quote (i.e. two single quotes in a row) within single quotes.

What a nightmare. But finally got it to work.
Please sign in to rate this answer.

9 people found this answer helpful.
Rachael Cecilia Dsouza 96 Reputation points

2021-06-16T20:25:06.557+00:00

This works perfectly .The issue came up in data factory as well and adding @ hide (replace(activity('Execute a failing Pipeline').error.message, '"','''')) worked perfectly for us.

Thank you

Anusha Dodda ( External) 1 Reputation point

2021-10-04T19:10:08.007+00:00

Hi ,It worked for me
Thanks much!

sarabjit85 1 Reputation point

2022-08-04T15:44:19.277+00:00

Where are you putting this?

Amol Shinde 1 Reputation point

2022-12-30T13:23:45.893+00:00

HI Zhukovsky,

It's worked for me as well after spending 2 days .

it's a very bad nightmare,

Thanks for the response.

Balaji J 0 Reputation points

2023-02-14T11:33:04.3966667+00:00

Thanks. This is works for me.

samuma 1 Reputation point Microsoft Employee

2023-06-30T18:16:51.0166667+00:00

THANK YOU!! This is what worked for me in the end as well. (the copy/paste without clicking "dynamic content" did not work for me)

Thanks Mark!

Varshaben Nannulal Ahirwal (MINDTREE LIMITED) 1 Reputation point Microsoft Vendor

2023-07-03T17:12:17.2466667+00:00

Thank you so much for this amazing solution. I knew it has something to do with the quotes but wasnt able to solve it.

I am using Set variable (for skipped and failed) so as to capture error from the whole pipeline and then pass it to Execute pipeline activity
Sign in to comment
Balaji J 0 Reputation points

2023-02-14T11:35:10.91+00:00

This is works fine. Thank you for providing resolution.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment