question

NandanHegde-7720 avatar image
0 Votes"
NandanHegde-7720 asked ·

Any correlation between PipelineId and CorelationId in ADF

Hello ,
Is there any relationship between pipelinerunid and correlationId in ADF v2?

We have enabled LogAnalytics in ADF v2 and now we need to backtrack a pipelinerun for which I have its PipelineRunid.

So how should I filter out the log data based on pipelinerunid?

There are some posts wherein they have mentioned that corelationid and pipelineid are same :
https://stackoverflow.com/questions/54034373/adf-log-analytics-how-to-correlate-multiple-pipelines
But that is not the case.

So wanted the help on the same

azure-data-factory
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

2 Answers

ChiragMishra-MSFT avatar image
0 Votes"
ChiragMishra-MSFT answered ·

Hi @NandanHegde-7720,

PipelineID is the ID of the pipeline run.

CorrelationId is the unique ID for tracking a particular request.

GEEyC.png

Ref: Monitor and Alert Data Factory by using Azure Monitor

How should I filter out the log data based on PipelineRunId?

When we open the logs, we query the log tables ADFPipelineRun and ADFActivityRun by column PipelineRunId/RunID.

For example:

DftfH.png

For more details, you could ref: Tutorial: Get started with Log Analytics queries.

Ref - https://stackoverflow.com/a/62526542/10653466

Hope this helps.


· 1 ·
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

ChiragMishra-MSFT avatar image ChiragMishra-MSFT ·

Hi @NandanHegde-7720,

Did the above suggestion help resolve your query? If yes, please consider accepting it as answer. This will help other community members going through this thread.

0 Votes 0 ·
PrashantPatiyanrajendran-6069 avatar image
0 Votes"
PrashantPatiyanrajendran-6069 answered ·

Can we have a query that shows the parent pipeline that failed and just that exact activity that failed within the parent pipeline. Is there a way to traverse from the activity that failed all the way back to the pipeline that triggered this activity.

·
10 |1000 characters needed characters left characters exceeded
Toggle Comment visibility. Current Visibility: Visible to all users

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.