question

WayneBartkowski-4236 avatar image
0 Votes"
WayneBartkowski-4236 asked VaibhavChaudhari commented

Pipeline count of records processed

I have a web activity included in my Data Factory pipeline that inserts some information into a table in the database on success of the pipeline. I was trying to find a parameter to include in the message that would show the number of rows processed. This will give me data to analyse about the jobs over time. An example of the code is below:

 {"dbo.Notifications":{"_id":"1","_Message":"The data import from source db to target completed successfully.}","_DateModified":"@{utcnow()}","_NotificationType":"Info","_RecordCount:codeforrecordcount}}

Thanks

azure-data-factory
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

ChiragMishra-MSFT avatar image
1 Vote"
ChiragMishra-MSFT answered VaibhavChaudhari commented

Hi anonymous user,


Are you using the web activity to write data or do you have a copy activity for copying ? If you have a copy activity, you can chain the web activity to it's success and use the output value like this:


 @activity('copyActivity').output.rowsCopied


Hope this helps.




· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Yes that was it thanks.

 {"dbo.Notifications":{"_id":"1","_Message":"The data import from src table to SQL DB completed successfully.}","_DateModified":"@{utcnow()}","_NotificationType":"Info","_RecordCount":"@activity('copyname').output.rowsCopied"}}

Can you point me to the document for these parameters, the "Intellisense" does not recommend anything.

0 Votes 0 ·

Glad to hear that the issue was resolved. Please accept it as answer as it would help other community members going through this thread.

Here's a document for parameters available in ADF :

https://docs.microsoft.com/en-us/azure/data-factory/control-flow-expression-language-functions

Quick Tip -> To quickly check all attributes in the output of any activity, chain a set variable activity to hold the output object as string and debug the pipeline. In your debug results, you can see the various attributes available for any type of activity.

0 Votes 0 ·
GB-4428 avatar image GB-4428 ChiragMishra-MSFT ·

Is there documentation for all attributes in the output of any activity? Eg rowsCopied for one

0 Votes 0 ·
Show more comments