Azure data factory and Databricks

Question

https://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-databricks-notebook

I am reading to above page and have serveral questions.

1. If i am going to add link service to databicks, using private link and Self host IR .... would that be possible ? Using Assess token
2. If using Access token , what permission are needed on databricks workspace ?
3. If using Managed service identity , what permission are needed on databricks workspace ?

thanks .

Answer 1

Hi @sakuraime ,

Azure Databricks linked service connect Via Azure IR only.

Authentication using Azure Databricks personal access tokens, anyone who have access to databricks workspace can create Access tokens.

You could access the Databricks Personal Access Token pass directly or through Key-Vault.

The AAD tokens support enables us to provide a more secure authentication mechanism leveraging Azure Data Factory's System-assigned Managed Identity while integrating with Azure Databricks.

Note: You need to grant the Data Factory instance 'Contributor' permissions in Azure Databricks Access Control.

You can directly use Managed Identity in Databricks Linked Service, hence completely removing the usage of Personal Access Tokens.

Hope this helps. Do let us know if you any further queries.

------------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

so access https://adb-******.net must through public internet ?