question

chrisw-1001 avatar image
3 Votes"
chrisw-1001 asked AndreasHug-3271 answered

Data Factory: Azure IR remains in "Running (Limited)" state after creation. Error message shows "Dataflow: Failed"

When I try to create an Azure IR with managed virtual network enabled, the DataFlow provisioning fails:

= Data movement, interactive query, pipeline and external activities: Succeeded
= Dataflow: Failed
= IRs can take 15 minutes to be ready for dataflow from the time they are created.

The Azure IR remains in a "Running (Limited)" state despite waiting over 24 hours. I have tried this multiple times and the result is the same.

Can anyone tell me why this is happening or offer advice on how to troubleshoot this error?

Thanks in advance.

12/14/2020 - Issue resolved. (See remainder of thread for details.)
12/11/2020 - Thanks to all for confirming that this is a larger issue. I am now working with Microsoft on the issue and will update this thread with the outcome.




azure-data-factory
· 6
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@chrisw-1001 Thanks for using Microsoft Q&A.
In which region you are trying to create your Azure IR ? Do you have any specific compute type you are configuring while creating it ?

0 Votes 0 ·

Hi @SaurabhSharma-msft,

Thank for your reply.

I am using the default compute configuration:

Region: EastUS
Compute Type: General purpose
Core type: 4 (+ 4 Driver Cores)
TTL: 0 Minutes

0 Votes 0 ·

Same here.
West Europe

47016-image.png


0 Votes 0 ·
image.png (72 B)

Same here.
West Europe

47016-image.png


0 Votes 0 ·

Same here:

Data movement, interactive query, pipeline and external activities: Succeeded
Dataflow: Failed
IRs can take 15 minutes to be ready for dataflow from the time they are created.

Region: East US 2
Compute type: General purpose
Core count: 4 (+ 4 Driver cores)
Time to live: 0

It also happens when Region is set as Auto Resolve

0 Votes 0 ·

Same error is occurring in Region: East US

0 Votes 0 ·
SaurabhSharma-msft avatar image
0 Votes"
SaurabhSharma-msft answered DhananjayaMata-9965 published

@chrisw-1001 @PawelPiwowarczyk-8297 @Dano-8889 @KrishnaKumar-6869 Sorry for your trouble. I got to know internally from products team that there was an issue with VNET IR's which have been fixed now. This issue was happening only for newly created IR's with VNET enabled. No impact to any existing IR's with VNet. Can you please check if your issues got resolved now.

· 5
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @SaurabhSharma0303,

It seems to be working now on East US 2. Dataflow provisioning has been successful and IR's status is Running.
I've done some tests with Data Flow activity and data is being mapped and copied to sink table successfully.

Thank you very much.

1 Vote 1 ·

@SaurabhSharma0303 ,

It's working now on East!

Thank you for your help!


1 Vote 1 ·

@chrisw-1001 Dano-8889 Thanks for the confirmation and glad that your issue has been resolved.

1 Vote 1 ·

@SaurabhSharma-msft

I am experiencing the same issue today in WestUS2. Any suggestions what else I might check?

Thank you!

0 Votes 0 ·

hi @SaurabhSharma-msft I have similar issue in Australia east region .Please advise

0 Votes 0 ·
obest avatar image
0 Votes"
obest answered

Stumbled upon the same issue today in West Europe.

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

NemesioLopez-2413 avatar image
0 Votes"
NemesioLopez-2413 answered NemesioLopez-2413 published

I have the same issue on East Us, is there a solution without re-creating a new Data Factory?

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

AndreasHug-3271 avatar image
1 Vote"
AndreasHug-3271 answered

I'm experiencing the same error as well. Any updates/remedies on this?

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.