question

hitler007-2883 avatar image
0 Votes"
hitler007-2883 asked MartinJaffer-MSFT edited

adf_client.activity_runs.query_by_pipeline_run while debugging pipeline

I am using adf_client.activity_runs.query_by_pipeline_run inside my azure notebook to get pipeline details (such as output/pipeline status/child pipeline execution time). I am passing the pipeline run id as the base parameter to this notebook. However, I am able to get the details when i publish and trigger it but not when i debug the pipeline.

azure-data-factory
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @hitler007-2883 and welcome to Microsoft Q&A.

The reason you are able to query published & triggered pipelines, but not debug pipelines, is because they are considered to be different types of runs. Debug pipeline run data is not kept as long (I think?).

I will inquire as to how to retrieve activity data of debug runs.

1 Vote 1 ·

Hi @MartinJaffer-MSFT ,

Thank you for the response.

So, any update as to how to retrieve activity data of debug runs?

0 Votes 0 ·

I'm sorry, @hitler007-2883 ,
I haven't gotten responses on any of my recent escalations. Just in case they tell me debug details aren't available via SDK, I have done some investigation into alternatives.

By inspecting browser traffic when using the ADF UI, I found some endpoints that may be of use. While the endpoints aren't a class, they are a starting point for a work-around. I expect they work similar to the other ADF REST API endpoints.

base url:

https://management.azure.com/subscriptions/{subscription_id}/resourcegroups/{resource_group_name}/providers/Microsoft.DataFactory/

... factories/{factory_name}/querydebugpipelineruns?api-version=2018-06-01
(with no other parameters)

....factories/{factory_name}/sandboxPipelineRuns/{run_id}/sandboxActivityRuns?

with parameters
- startTime
- endTime
- api-version


0 Votes 0 ·

0 Answers