Cannot access Databricks sample data sets

Bos, ROY (Roy) 1 Reputation point
2022-05-16T14:25:35.937+00:00

On our Databricks instances, trying to access the Databricks sample data sets using display(dbutils.fs.ls('/databricks-datasets/')) or equivalent as described here, the commands keep running without giving an output. Normally these data sets should be available even in new clusters. Data in the file store can be accessed normally. Here are some settings we use that might be relevant:

spark_conf = {
  "spark.databricks.cluster.profile"                = "serverless"
  "spark.databricks.passthrough.enabled"            = true
  "spark.databricks.delta.preview.enabled"          = true
  "spark.databricks.pyspark.enableProcessIsolation" = true
  "spark.databricks.repl.allowedLanguages"          = "python,sql"
}
.NET
.NET
Microsoft Technologies based on the .NET software framework.
3,424 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,948 questions
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA-MSFT 78,576 Reputation points Microsoft Employee
    2022-05-17T05:34:57.603+00:00

    Hello @Bos, ROY (Roy) ,

    Thanks for the question and using MS Q&A platform.

    When you say "commands keep running" - how long it keeps on running? Could you please try to create a new cluster and see if you are experiencing similar behaviour.

    As per the repro from our end, it's working as excepted without any issue.

    202681-adb-databricks-datasets.gif

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators