Connecting a notebook remotely to an Azure Spark Pool machine.

Ivar Stangeby 21 Reputation points
2020-11-17T11:16:19.657+00:00

Hi!

I am looking into the possiblity of creating a hosted notebook service, using nteract.io as a frontend, with the notebooks running in Azure Synapse.
I see that the REST API is capable of provisioning new Apache Spark pools, and that you can run specific notebooks from end-to-end using the API.
However, I would like to offer an interactive notebook experience. My question is therefore:

Is it possible to connect to a remote kernel running in Azure Synapse? So, the user edits a notebook from a different interface than the Synapse notebook UI, and directs
cell-executions and response to a machine in a selected Apache Spark pool?

If so, how would I go about doing that? Assuming I already have the spark pool set up and ready to go.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,422 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 78,331 Reputation points Microsoft Employee
    2020-11-18T12:06:04.48+00:00

    Hello @Ivar Stangeby ,

    Welcome to the Microsoft Q&A platform.

    Unfortunately, connecting a notebook remotely to an Azure Spark pool machine is not supported.

    Note: Currently Azure Synapse is in public preview, and most of the features and not supported and these are in our feature backlog.

    I would suggest you to provide feedback on the same:

    https://feedback.azure.com/forums/307516-azure-synapse-analytics

    All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.

    Hope this helps. Do let us know if you any further queries.

    ------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

0 additional answers

Sort by: Most helpful