How do I use the Script activity in ADF, so it uses Azure Databricks SQL Warehouse

Question

I want to be able to use ADF Script activity to execute SQL statements on the Azure Databricks SQL warehouses (including the serverless kind).
https://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-script

Azure Databricks SQL warehouse accepts REST API SQL statements, so it should not be to complex to implement this functionality. There is also option to connect via JDBC.

Snowflake has it, so databricks has to have it as well.

Introducing this functionality would be ideal for quick queries like metadata retrieval

Answer 1

Hello Krzysztof Przysowa,

Welcome to the Microsoft Q&A forum.

Currently, you can't use ADF Script activity to execute SQL statements on the Azure Databricks SQL warehouses.

I would suggest submitting this idea to the ADFfeedback channel. Which would be open for the user community to upvote & comment on. This allows product teams to effectively prioritize your idea against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

https://feedback.azure.com/d365community/forum/1219ec2d-6c26-ec11-b6e6-000d3a4f032c

Also please do share the link once the feedback is posted so that we can pass the feedback to respective product owners for further review.

Hope this info helps.