question

AdelekeAbimbola-6949 avatar image
0 Votes"
AdelekeAbimbola-6949 asked AdelekeAbimbola-6949 answered

RowsWritten from data flow in log analytics

I was recently able to get the rowsCopied and rowsRead from a pipeline copy activity in log analytics....I'm trying to get the rowsWritten from the pipeline dataflow activity but I'm not getting any input.
Is this even logged in log analytics? and if it is, how can I get it?

azure-data-factoryazure-monitorazure-data-lake-analytics
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

HimanshuSinha-MSFT avatar image
1 Vote"
HimanshuSinha-MSFT answered

Hello @AdelekeAbimbola-6949 ,
Thanks for the ask and using Microsoft Q&A platform .
Thanks for correcting me on the other thread , which kind of motivated me to dig more .

Yes it is logged , I used a MDF to copy data from blob to blob . amd the below query helped me out to get the rowcount .

ADFActivityRun
|extend d=parse_json(Output)
|extend rowsWritten=d.runStatus.metrics.sink1.rowsWritten
|extend duration_value=d.runStatus.metrics.sink1.sources.Blob.rowsRead
|where OperationName in ('Data flow1 - Succeeded')

136016-image.png

Please do let me know how it goes .
Thanks
Himanshu


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators



image.png (48.6 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

AdelekeAbimbola-6949 avatar image
0 Votes"
AdelekeAbimbola-6949 answered

Thank you @HimanshuSinha-MSFT , this worked for me. I was able to get the information I needed from the DataFlow activity. Thank you very much.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.