question

CheuEngYeow-5385 avatar image
0 Votes"
CheuEngYeow-5385 asked CheuEngYeow-5385 edited

Mounting Azure Data Lake Store Gen 2 to Azure Synapse Analytics Spark Pool

Azure Databricks allows ADLS2 to be mounted as a local drive. Does Azure Synapse Analytics allow mounting of ADLS2 in Spark Pool?

azure-synapse-analyticsazure-databricksazure-data-lake-storage
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PRADEEPCHEEKATLA-MSFT avatar image
0 Votes"
PRADEEPCHEEKATLA-MSFT answered

Hello @CheuEngYeow-5385,

Welcome to the Microsoft Q&A platform.

Currently, Azure Synapse Analytics doesn't allow mounting of ADLS2 in Spark Pool.

As per the conversation with product team, they are working on this feature and it will be available soon.

I will update the thread once it goes live.

Hope this will help. Please let us know if any further queries.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

CheuEngYeow-5385 avatar image
0 Votes"
CheuEngYeow-5385 answered CheuEngYeow-5385 edited

BEWARE: The Spark Pool when shutdown will remove some working folders. Do at your own risk. Files may be removed when Spark Pool is shutting down.

Discover that blobfuse is installed in Spark Pool.
Follow the instructions here to mount your blob storage.
Use Python subprocess to run the command.

https://docs.microsoft.com/en-us/azure/storage/blobs/storage-how-to-mount-container-linux

· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @CheuEngYeow-5385,

Glad to know that your issue has resolved. And thanks for sharing the alternate solution, which might be beneficial to other community members reading this thread.

0 Votes 0 ·