question

NemesioLopez-2413 avatar image
0 Votes"
NemesioLopez-2413 asked GabrielGava-8266 edited

DataFlow error in Data Factory

I got this error when trying to run a pipeline that include just a DataFlow task, the database uses a private endpoint and the dataset used is working in other pipelines, but we got an error when we test the connection in the Sink element of the DataFlow. The linked service uses a VNIntegrationRuntime, and it is working also, we only get this error in the DataFlow. {"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'SinkGen': java.lang.RuntimeException: Cannot connect to SQL database: 'jdbc:sqlserver://XXX.database.windows.net:1433;database={XXXX}', 'User: XXX'.[SQL Exception]Error Code:47073, Error Message: Reason: An instance-specific error occurred while establishing a connection to SQL Server. Connection was denied since Deny Public Network Access is set to Yes (https://docs.microsoft.com/azure/azure-sql/database/connectivity-settings#deny-public-network-access). To connect to this server, use the Private Endpoint from inside your virtual network (https://docs.microsoft.com/azure/sql-database/sql-database-private-endpoint-overview#how-to-set-up-private-link-for-azure-sql-database). ClientConnectionId:317299fa-411d-40d7-a642-deb00781ef8f, error stack:shaded.msdataflow.com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:259)\nshaded.msdataflow.com.microsoft.sqlserver.jdbc.TDSTokenHandler.onEOF(tdsparser.java:256)\nshaded.msdat","Details":"at Sink 'SinkGen': java.lang.RuntimeException: Cannot connect to SQL database: 'jdbc:sqlserver://XXX.database.windows.net:1433;database={XXX}', 'User: XXX![79402-errordf.jpg][1]'.[SQL Exception]Error Code:47073, Error Message: Reason: An instance-specific error occurred while establishing a connection to SQL Server. Connection was denied since Deny Public Network Access is set to Yes (https://docs.microsoft.com/azure/azure-sql/database/connectivity-settings#deny-public-network-access). To connect to this server, use the Private Endpoint from inside your virtual network (https://docs.microsoft.com/azure/sql-database/sql-database-private-endpoint-overview#how-to-set-up-private-link-for-azure-sql-database). ClientConnectionId:317299fa-411d-40d7-a642-deb00781ef8f, error stack:shaded.msdataflow.com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:259)\nshaded.msdataflow.com.microsoft.sqlserver.jdbc.TDSTokenHandler.onEOF(tdsparser.java:256)\nshaded.msdataflow.com.microsoft.sqlser"} [1]: /answers/storage/attachments/79402-errordf.jpg

azure-data-factoryazure-sql-database
errordf.jpg (43.6 KiB)
· 10
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Is this error still occurring, or was it a transient error?

0 Votes 0 ·

It is still occurring

0 Votes 0 ·

From inside the Sink transformation in the data flow designer, does your test connection work?

79775-image.png


0 Votes 0 ·
image.png (15.8 KiB)
Show more comments

Hi @nemesiolopez-2413,

Thanks for reaching out. Could you also please confirm if your dataset uses Self Hosted Integration runtime? The reason I would want to confirm on this because ADF Data flow doesn't support SHIR hence you will have to use a Azure IR.

We look forward to your confirmation.

Thanks

0 Votes 0 ·
Show more comments

0 Answers