Get Workspace, Cluster, Notebook, and Job Identifiers

This article explains how to get workspace, cluster, notebook, and job identifiers and URLs in Azure Databricks.

Workspace Instance and ID

An instance name is assigned to each Azure Databricks deployment. To segregate the workload and grant access to only relevant users, usually Azure Databricks customers create separate instances for development, staging, and production. The instance name is the first part of the URL when you log into your Azure Databricks deployment.

If you log into https://westus.azuredatabricks.net/, the instance name is westus.azuredatabricks.net.

An Azure Databricks Workspace is where the Azure Databricks platform runs and where you can create Spark clusters and schedule workloads. A workspace has a unique Workspace ID. In the deployment URL, for example, https://<databricks-instance>/?o=6280049833385130, the random number after o= is the Azure Databricks workspace ID. Here the Workspace ID is 6280049833385130.

Cluster URL

Azure Databricks clusters provide a unified platform for various use cases such as running production ETL pipelines, streaming analytics, ad-hoc analytics, and machine learning. Each cluster in Azure Databricks has a unique ID called the cluster ID. This is applicable for both interactive and automated clusters. To get the details of a cluster using the REST API, the cluster ID is essential. To get the cluster ID, click the Clusters tab in left pane and then select a cluster name. The URL of this page https://<databricks-instance>/#/settings/clusters/<cluster-id> has the cluster ID.

In the following screenshot, the cluster ID is 0831-211914-clean632.

no-alternative-text

Notebook URL

A notebook is a web-based interface to a document that contains runnable code, visualizations, and narrative text. Notebooks are one interface for interacting with Azure Databricks. Each notebook has a unique ID. The notebook URL has the notebook ID, hence the notebook URL is unique to a notebook. It can be shared with anyone on Azure Databricks platform with permission to view and edit the notebook. In addition, each notebook cell has a different URL.

In the following notebook, the notebook URL is https://westus.azuredatabricks.net/?o=6280049833385130#notebook/1940481404050342 and the cell URL is https://westus.azuredatabricks.net/?o=6280049833385130#notebook/1940481404050342/command/2432220274659491.

no-alternative-text

Job URL

A job is a way of running a notebook or JAR either immediately or on a scheduled basis. To get to a job URL, click the Jobs tab in left pane and click a job name. This job URL is very critical piece of information needed to troubleshoot job runs that have failed and investigate the root cause.

In the following screenshot, the job URL is https://westus.azuredatabricks.net/?o=6280049833385130#job/1.

no-alternative-text