Azure synapse spark function df.write.synapsesql

Question

https://learn.microsoft.com/en-us/azure/synapse-analytics/spark/synapse-spark-sql-pool-import-export

i think it means it will require no current table in the sql pool .

can do append ? or merge ??

which the original one from Databricks sparks can also do APPEND....(quite shock it's even worst in Azure synapse spark pool .....).....

Answer 1

Hi Microsoft Team,

Any solution to above issue.?? seems still df.write.synapsesql is not having append or overwrite option.

In addition to write function, read function is also having issues with python cells, below is the cell which is written in spark and is running fine but when calling this table in pyspark sql it is saying object not found.

%%spark
val table = spark.read.sqlanalytics("dbname.schemaname.table ")
table .createOrReplaceTempView("table ")

Answer 2

Hi @sakuraime ,

Thanks for your patience. Product team confirmed that this is a limitation and there is no roadmap to implement the change in near future. Please use this forum for posting and upvoting your ideas that would resolve the challenges. Ideas posted here are closely monitored by the product team and implemented in future releases.

Appreciate your support!

--

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a notification.