question

TendaiTakavarasha-2877 avatar image
0 Votes"
TendaiTakavarasha-2877 asked SumanthMarigowda-MSFT edited

403 on dataflow sink to Azure Synpase when the storage account is only accepting selected networks



  • I have a datafactory deployed in South Africa North Region. The intergration runtime has Virtual Network Configuration enabled i.e the IR runs the same Region and VN as the Data Factory.

  • I have a Data Flow that is trying to sink the output in Azure Synapse and the Synapse workspace is also in the same Region with a Managed Virtual Network and has a private Enpoint that connects it to the Data Factory

  • The Storage account is in the same region and can only accept Selected Networks and there is a private endpoint that connects it to the Data Factory.

  • The issue is when my Storage account Firewall rules allows access from all networks i can sink the data in synapse without any issue but If I close it down to selected networks and add a private endpoint that connects it to the Data factory it fails with a 403 as below:

103366-screenshot-2021-06-08-at-111249.png

Fetching data from Synapse using the Data Factory even when the Firewall is closed down to selected networks is working fine.

The issue seems to be related to this question on Stack Overflow but the user here was tryng to sink in the Storage Account itself not Azure Synapse. Just like this user I need the IR to be in the same region with all the other resource and my security team will not allow to open up the firewalls in production. I am also failing to find the link with sinking to azure synapse and storage account setting having to determine the outcome. I even disabled staging on the sink settings but the storage account setting still determines the error.


azure-data-factoryazure-synapse-analytics
· 4
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @TendaiTakavarasha-2877 and welcome to Microsoft Q&A.

You have provided a good deal of information, but there are some points confusing me.

You mention both Data Factory and Synapse. Do you have a separate instance of each, or are you using the Data-Factory-like workspace included in a Synapse Workspace?

Is your Synapse a full Synapse workspace, or just the SQL pool (previously known as SQL Data Warehouse).

0 Votes 0 ·

Hi @MartinJaffer-MSFT .I have a seperate full Synapse Workspce but I am mainly using it as a Data Store in dedicated SQL Pools and I also have a separate instance of Data Factory which I am using using for pipeline ochestration.

0 Votes 0 ·

I suspect things would work more easily, if the same instance was used for both orchestration and data store.


This looks like it will be a very complicated case. Can I interest you in a support ticket for a deeper and more personal investigation, @TendaiTakavarasha-2877 ?

0 Votes 0 ·
Show more comments

0 Answers