question

Bhargav-5566 avatar image
0 Votes"
Bhargav-5566 asked Baggachinni-7851 commented

The specified filesystem does not exist error on synapse

%%pyspark
spark.sql("CREATE DATABASE IF NOT EXISTS nyctaxi1")


AnalysisException: java.lang.RuntimeException: java.io.FileNotFoundException: Operation failed: "The specified filesystem does not exist.", 404, HEAD, https://<staorageaccount>.dfs.core.windows.net/testfs/?upn=false&action=getAccessControl&timeout=90;
Traceback (most recent call last):

File "/opt/spark/python/lib/pyspark.zip/pyspark/sql/session.py", line 767, in sql
return DataFrame(self._jsparkSession.sql(sqlQuery), self._wrapped)

File "/opt/spark/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py", line 1257, in call
answer, self.gateway_client, self.target_id, self.name)

File "/opt/spark/python/lib/pyspark.zip/pyspark/sql/utils.py", line 75, in deco
raise AnalysisException(s.split(': ', 1)[1], stackTrace)

pyspark.sql.utils.AnalysisException: java.lang.RuntimeException: java.io.FileNotFoundException: Operation failed: "The specified filesystem does not exist.", 404, HEAD, https://<staorageaccount>.dfs.core.windows.net/testfs/?upn=false&action=getAccessControl&timeout=90;




azure-synapse-analytics
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SamaraSoucy-MSFT avatar image
0 Votes"
SamaraSoucy-MSFT answered Baggachinni-7851 commented

I'm guessing you are following this tutorial? https://docs.microsoft.com/en-us/azure/synapse-analytics/get-started-analyze-spark#load-the-nyc-taxi-data-into-the-spark-nyctaxi-database

Assuming the storage account exists, the first thing to check is permissions. You will need the Storage Blob Data Contributor role on the storage account for the quickstart to work.

That is usually the problem, but if that doesn't clear the error and it is a brand new pool, deleting and recreating the pool is another troubleshooting step to ensure that something did not go wrong during deployment.

Please let me know if either of these resolved your error. If not we can go through some additional troubleshooting.

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@Bhargav-5566

I'm just checking in- have you been able to resolve the error or is this issue still ongoing?

0 Votes 0 ·

It worked.

1 Vote 1 ·