question

sakuraime avatar image
2 Votes"
sakuraime asked KartheekKumarAdda-3709 answered

Azure synapse spark function df.write.synapsesql

https://docs.microsoft.com/en-us/azure/synapse-analytics/spark/synapse-spark-sql-pool-import-export

57006-image.png




i think it means it will require no current table in the sql pool .

can do append ? or merge ??


which the original one from Databricks sparks can also do APPEND....(quite shock it's even worst in Azure synapse spark pool .....).....

azure-synapse-analytics
image.png (30.7 KiB)
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @sakuraime,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

Yes, it will work only if the table does not exist in dedicated SQL Pool. Currently, it does not support append or merge. I understand the feature gap and challenges in additional code required due to this limitation. I reached out to product team if there are any plans in pipeline to implement the same. I will get back to you as soon as I hear from them.

Stay tuned!

0 Votes 0 ·

what's the link to vote to request this features..??? And also foreign key...........

0 Votes 0 ·
HarithaMaddi-MSFT avatar image
0 Votes"
HarithaMaddi-MSFT answered HarithaMaddi-MSFT commented

Hi @sakuraime,

Thanks for your patience. Product team confirmed that this is a limitation and there is no roadmap to implement the change in near future. Please use this forum for posting and upvoting your ideas that would resolve the challenges. Ideas posted here are closely monitored by the product team and implemented in future releases.

Appreciate your support!


  • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification.



· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

what a pity ... thanks

1 Vote 1 ·

Hi @sakuraime,

Apologies for the inconvenience. Please let us know for any further queries and we will be glad to assist.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members.

0 Votes 0 ·
KartheekKumarAdda-3709 avatar image
0 Votes"
KartheekKumarAdda-3709 answered

Hi Microsoft Team,

Any solution to above issue.?? seems still df.write.synapsesql is not having append or overwrite option.

In addition to write function, read function is also having issues with python cells, below is the cell which is written in spark and is running fine but when calling this table in pyspark sql it is saying object not found.

%%spark
val table = spark.read.sqlanalytics("dbname.schemaname.table ")
table .createOrReplaceTempView("table ")

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.