Cannot Read Azure Databricks Objects Stored in the DBFS Root Directory

Problem

An Access Denied error returns when you attempt to read Azure Databricks objects stored in the DBFS root directory in blob storage from outside an Azure Databricks cluster.

Cause

This is normal behavior for the DBFS root directory. Azure Databricks stores objects like libraries and other temporary system files in the DBFS root directory. Azure Databricks is the only user that can read these objects.

Solution

Azure Databricks does not recommend using the root directory for storing any user files or objects. Instead, create a different blob storage directory and mount it to DBFS.