I am getting an unspecified error when running UPDATE, DELETE and MERGE sql statements on Delta tables when using Spark SQL APIs. I can use Scala APIs fine, I’m wondering if anyone else is having the same issue?
Spark SQL DML statements with Delta tables
You can see here that SQL based DML is mostly not supported in the LF version of Delta Lake, it will come in the future.
https://docs.delta.io/latest/quick-start.html#create-a-table
-Euan
Hi @AndyCutler-3530 ,
Following up to see if the above info from @euangMS was helpful. If this answers your query, please do consider to click "accept the answer" and/or "Up-Vote" as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Hi @AndyCutler-3530 ,
Following up to see if the above info answers your query. If you have any further query do let us know.
The Linux Foundation version of Delta Lake which is the OSS one as opposed to the one from Databricks
Ah OK thanks. So the SQL DML statements only work on Databricks at the moment.
6 People are following this question.
