Error from databricks jobs API : Failed to retrieve tenant ID for given token

Question

I have a pipeline in ADF that failed today with a message that isn't familiar. It was connecting to the Databricks REST API.

Error 403 Failed to retrieve tenant ID for given token
HTTP ERROR 403
Problem accessing /api/2.0/jobs/runs/submit.
Reason: Failed to retrieve tenant ID for given token

I was assuming that someone had seen this message before but I googled for "Failed to retrieve tenant ID for given token" and found nothing.

I think this may be a home-grown message from azure-databricks.

The main problem is that I don't know who is responsible. AAD? ADF? Databricks?

And why would it be so hard to translate an oauth2 token into a tenant ID?

I think the OAUTH2 stuff is new for databricks (and ADF interaction with databricks). I think previously everyone had to use a PAT token. So perhaps there are still some growing pains associated with the new functionality?

Please let me know if anyone knows what it means when databricks Failed to retrieve tenant ID for given token

Answer 1

Resolution from Victor in Tech support:

**It could be due to a temporary issue within the platform which prevent the pipeline to get access to the DataBricks resource and causing the reported incident.

I do apologize for not being able to provide you with a more user oriented description about the reported issue as there is not more details for the research in our backend.**