question

ShanmugamS-2993 avatar image
0 Votes"
ShanmugamS-2993 asked ShaikMaheer-MSFT commented

I am getting error while running the spark job within the azure synapse analytics workspace

getting this error when running the spark job with sparkpool creation within the notebook and the job is not successfully executed

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Got exception: org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsRestOperationException Operation failed: "This request is not authorized to perform this operation using this permission.", 403, HEAD

azure-synapse-analyticsazure-monitorazure-databricksazure-data-lake-storagedotnet-ml-big-data
· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi @ShanmugamS-2993 ,

Just checking in to see if the above answer helped. If this answers your query, do click 130616-image.png and upvote 130671-image.png for the same. And, if you have any further query do let us know.

0 Votes 0 ·

Hi @ShanmugamS-2993 ,

Following to see if the above answer helped. If this answers your query, do click 130616-image.png and upvote 130671-image.png for the same. And, if you have any further query do let us know.

0 Votes 0 ·

1 Answer

ShaikMaheer-MSFT avatar image
0 Votes"
ShaikMaheer-MSFT answered

Hi @ShanmugamS-2993 ,

Welcome to Microsoft Q&A Platform. Thank you for posting query here.

You may be using managed identity or user account to run your notebook which doesn't has permissions to the workspace.

When you are working on synapse workspace with the managed identity you would need to give Storage Blob Data contributor permission to the workspace that represents the managed identity permission

Please check below link to know more details about Grant permissions to workspace managed identity,
https://docs.microsoft.com/en-us/azure/synapse-analytics/security/how-to-grant-workspace-managed-identity-permissions

Please check below link to know more about Azure Synapse workspace managed identity,
https://docs.microsoft.com/en-us/azure/synapse-analytics/security/synapse-workspace-managed-identity

Kindly check below blog also where similar issue discussed.
https://techcommunity.microsoft.com/t5/azure-synapse-analytics/notebook-this-request-is-not-authorized-to-perform-this/ba-p/1712566

Requesting you to grant Storage Blob Data contributor for your managed identity or user account and see.

Hope this will help you. Please let us know how it goes and if any further queries. Thank you.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.