Is it possible to update a table of Synapse Analytics (Data Warehouse) from Azure Databricks? Apparently using Pyspark, Scala or SparkR there is no update option. Besides, using Spark SQL the Update syntax does not work.

Hello @MASSIMO CAULI , Welcome to the Microsoft Q&A platform. You can update the Azure Synapse Analytics tables from Azure Databricks using overwrite mode. Overwrite mode means that when saving a DataFrame to a data source, if data/table already exists, existing data is expected to be overwritten by the contents of the DataFrame. As per the repro, I'm able to update the Azure Synapse Analytics Table from Azure Databricks. Reading the table data from Azure Synapse Analytics using Azure Databricks: Inserting the data into table of Azure Synapse Analytics Updating the columns in the table of Azure Synapse Analytics Hope this helps. Do let us know if you any further queries. --------------------------------------------------------------------------- Please " Accept the answer " if the information helped you. This will help us and others in the community as well.

Update Synapse Analytics Table from Databricks

Accepted answer

PRADEEPCHEEKATLA-MSFT 77,751 Reputation points Microsoft Employee

2021-05-31T06:22:57.42+00:00

Hello @MASSIMO CAULI ,

Welcome to the Microsoft Q&A platform.

You can update the Azure Synapse Analytics tables from Azure Databricks using overwrite mode.

Overwrite mode means that when saving a DataFrame to a data source, if data/table already exists, existing data is expected to be overwritten by the contents of the DataFrame.

As per the repro, I'm able to update the Azure Synapse Analytics Table from Azure Databricks.

Reading the table data from Azure Synapse Analytics using Azure Databricks:

Inserting the data into table of Azure Synapse Analytics

Updating the columns in the table of Azure Synapse Analytics

Hope this helps. Do let us know if you any further queries.

---------------------------------------------------------------------------

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.
Please sign in to rate this answer.

2 people found this answer helpful.
PRADEEPCHEEKATLA-MSFT 77,751 Reputation points Microsoft Employee

2021-06-02T07:10:23.787+00:00

Hello @MASSIMO CAULI ,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

PRADEEPCHEEKATLA-MSFT 77,751 Reputation points Microsoft Employee

2021-06-03T08:34:53.793+00:00

Hello @MASSIMO CAULI ,

Following up to see if the above suggestion was helpful. And, if you have any further query do let us know.
Take care & stay safe!

---------------------------------------------------------------------------

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.

Naveen Kumar 1 Reputation point

2022-03-22T07:20:25.193+00:00

tried the provided solution but it didn't helped. Throwed an error saying, "
com.databricks.spark.sqldw.SqlDWSideException: Azure Synapse Analytics failed to execute the JDBC query produced by the connector."
could you please help, I am trying to Update a synapse table from the pyspark dataframe that I have in Databricks.
I am having a synapse table with columns A,B,C,D and I have a Dataframe that has the values for column D that I need to update in the Synapse Table.

PRADEEPCHEEKATLA-MSFT 77,751 Reputation points Microsoft Employee

2022-03-22T09:59:59.373+00:00

Hello @Naveen Kumar ,

Thanks for the question and using MS Q&A platform.

I see you have already created a new thread: https://learn.microsoft.com/en-us/answers/questions/781726/accessing-synapse-table-from-databricks-using-pysp.html let us continue the discuss on the new thread.
Sign in to comment

Update Synapse Analytics Table from Databricks

0 additional answers