DILIP BHATTA • The error message you provided doesn’t directly relate to Azure Storage Account creation, but it seems to be related to Spark and temporary directories.
If you’re using Spark, ensure that your temporary directories are correctly configured. You can change the path to the temp folder for each Spark application using the spark.local.dir
property.
Additionally, proper cleanup of Spark’s _temporary
directory after an exception is essential. You can use standard file system commands (e.g., rm -r _temporary
in Unix-like systems) to remove the temporary directory. When you rerun the job, Spark will automatically recreate the _temporary
directory as needed.
If that doesn't help, please share the details requested in the comments above so that I can help you better.