question

RRNetha avatar image
0 Votes"
RRNetha asked ·

Writing the data to Azure SQL or on premise SQL using Synapse workspace

Hi - Please help me in understanding the capabilities of Synapse spark notebooks

  1. Can we Read/write the data from spark table to azure SQL database table in synapse workspace using spark notebooks

  2. Can we Read/Write the data from/to on premise SQL Server and Oracle in synapse workspace using spark notebooks

thanks



azure-synapse-analytics
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SamaraSoucy-MSFT avatar image
1 Vote"
SamaraSoucy-MSFT answered ·

There are MS SQL drivers included in the default libraries in Spark pools that will allow connections to Azure SQL and that will allow both read and write connections..

There is not currently a way to connect a Spark notebook directly to your on-prem resources. The best way to work with this is to pull the data into something like Data Lake first, run your notebook on that, then write it back to your on-prem servers. Synapse Pipelines should allow this, as will Azure Data Factory. You will need to install a self-hosted runtime to allow connections to on-prem resources.


·
10 |1000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.