question

GeorgeDominguez-6963 avatar image
0 Votes"
GeorgeDominguez-6963 asked MartinJaffer-MSFT commented

Azure ADF Power Query (Preview)

I use the new Power Query (Preview) in the following pipeline. In "Debug" mode, it works as expected. However, when I execute the pipeline via trigger, it Skips the power query step.

101196-power-query-in-azure.png


Execution via Trigger:

101197-power-query-in-azure-skipped.png



Error message:

DetailsThe execution of template action 'MainPwQryFreight' is skipped: the 'runAfter' condition for action 'ExecuteMappingResolvedPwQryFreight' is not satisfied. Expected status values 'Succeeded' and actual value 'Failed'.

Anybody else experienced the same thing, and how did you overcome the issue?






azure-data-factory
· 5
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @GeorgeDominguez-6963 and welcome to Microsoft Q&A.

The error message you see refers to the connection between activities (dependencies). From your screenshot it looks like the skipped activity "MainPwQryFreight" is the first activity in the pipeline. As the first activity in the pipeline, we should not be seeing this message, so something is weird.

If you just want to get passed this and move on, try placing a Wait Activity in front of this activity, connected by green on-success dependency. I expect this would fix any dependency strangeness.

For a deeper investigation, I would need to first look at the pipeline JSON around this activity.

0 Votes 0 ·

Hi MartinJaffer-MSFT

I have tried doing that; as you can appreciate from the screenshot below, it's interesting how it loses the integration runtime via a trigger?

101485-power-query-in-azure-skipped-01.png


I tried the same functionality using Dataflow with success:

101551-power-query-in-azure-dataflow.png


Here is what I think is happening:
The Power Query (Preview) asset can not spin an Apache Spark cluster via the trigger engine. It works in debug mode because I manually spin the data bricks cluster from the "Data Flow Debug" button.

When submitted to the trigger, it loses its Integration Runtime.

101542-power-query-in-azure-ir.png



The question where to from here?

0 Votes 0 ·

Ouch, that is some odd behavior.

I haven't used Power Query in a long time, so I'll try a simple one and check whether mine says Unknown runtime or not.

I have not found any similar cases or resources for this particular situation. I expect this will require deeper investigation than I can give over the forums. Have you opened a support ticket about this issue? If so, can you share the ticket number, if not I can help you get one.

0 Votes 0 ·
Show more comments

0 Answers