Run Jupyter Notebooks in your workspace
Learn how to run your Jupyter notebooks directly in your workspace in Azure Machine Learning studio. While you can launch Jupyter or JupyterLab, you can also edit and run your notebooks without leaving the workspace.
For information on how to create and manage files, including notebooks, see Create and manage files in your workspace.
- An Azure subscription. If you don't have an Azure subscription, create a free account before you begin.
- A Machine Learning workspace. See Create an Azure Machine Learning workspace.
Edit a notebook
To edit a notebook, open any notebook located in the User files section of your workspace. Click on the cell you wish to edit. If you don't have any notebooks in this section, see Create and manage files in your workspace.
You can edit the notebook without connecting to a compute instance. When you want to run the cells in the notebook, select or create a compute instance. If you select a stopped compute instance, it will automatically start when you run the first cell.
When a compute instance is running, you can also use code completion, powered by Intellisense, in any Python notebook.
You can also launch Jupyter or JupyterLab from the notebook toolbar. Azure Machine Learning does not provide updates and fix bugs from Jupyter or JupyterLab as they are Open Source products outside of the boundary of Microsoft Support.
Use focus mode to expand your current view so you can focus on your active tabs. Focus mode hides the Notebooks file explorer.
In the terminal window toolbar, select Focus mode to turn on focus mode. Depending on your window width, this may be located under the ... menu item in your toolbar.
While in focus mode, return to the standard view by selecting Standard view.
IntelliSense is a code-completion aid that includes a number of features: List Members, Parameter Info, Quick Info, and Complete Word. These features help you to learn more about the code you're using, keep track of the parameters you're typing, and add calls to properties and methods with only a few keystrokes.
When typing code, use Ctrl+Space to trigger IntelliSense.
Clean your notebook (preview)
Over the course of creating a notebook, you typically end up with cells you used for data exploration or debugging. The gather feature will help you produce a clean notebook without these extraneous cells.
- Run all of your notebook cells.
- Select the cell containing the code you wish the new notebook to run. For example, the code that submits an experiment, or perhaps the code that registers a model.
- Select the Gather icon that appears on the cell toolbar.
- Enter the name for your new "gathered" notebook.
The new notebook contains only code cells, with all cells required to produce the same results as the cell you selected for gathering.
Save and checkpoint a notebook
Azure Machine Learning creates a checkpoint file when you create an ipynb file.
In the notebook toolbar, select the menu and then File>Save and checkpoint to manually save the notebook and it will add a checkpoint file associated with the notebook.
Every notebook is autosaved every 30 seconds. Autosave updates only the initial ipynb file, not the checkpoint file.
Select Checkpoints in the notebook menu to create a named checkpoint and to revert the notebook to a saved checkpoint.
Export a notebook
In the notebook toolbar, select the menu and then Export As to export the notebook as any of the supported types:
The exported file is saved on your computer.
Run a notebook or Python script
To run a notebook or a Python script, you first connect to a running compute instance.
If you don't have a compute instance, use these steps to create one:
- In the notebook or script toolbar, to the right of the Compute dropdown, select + New Compute. Depending on your screen size, this may be located under a ... menu.
- Name the Compute and choose a Virtual Machine Size.
- Select Create.
- The compute instance is connected to the file automatically. You can now run the notebook cells or the Python script using the tool to the left of the compute instance.
If you have a stopped compute instance, select Start compute to the right of the Compute dropdown. Depending on your screen size, this may be located under a ... menu.
Only you can see and use the compute instances you create. Your User files are stored separately from the VM and are shared among all compute instances in the workspace.
View logs and output
Use notebook widgets to view the progress of the run and logs. A widget is asynchronous and provides updates until training finishes. Azure Machine Learning widgets are also supported in Jupyter and JupterLab.
Explore variables in the notebook
On the notebook toolbar, use the Variable explorer tool to show the name, type, length, and sample values for all variables that have been created in your notebook.
Select the tool to show the variable explorer window.
Navigate with a TOC
On the notebook toolbar, use the Table of contents tool to display or hide the table of contents. Start a markdown cell with a heading to add it to the table of contents. Click on an entry in the table to scroll to that cell in the notebook.
Change the notebook environment
The notebook toolbar allows you to change the environment on which your notebook runs.
These actions will not change the notebook state or the values of any variables in the notebook:
|Stop the kernel||Stops any running cell. Running a cell will automatically restart the kernel.|
|Navigate to another workspace section||Running cells are stopped.|
These actions will reset the notebook state and will reset all variables in the notebook.
|Change the kernel||Notebook uses new kernel|
|Switch compute||Notebook automatically uses the new compute.|
|Reset compute||Starts again when you try to run a cell|
|Stop compute||No cells will run|
|Open notebook in Jupyter or JupyterLab||Notebook opened in a new tab.|
Add new kernels
Use the terminal to create and add new kernels to your compute instance. The notebook will automatically find all Jupyter kernels installed on the connected compute instance.
Use the kernel dropdown on the right to change to any of the installed kernels.
An indicator next to the Compute dropdown shows its status. The status is also shown in the dropdown itself.
|Light Blue||Compute creating, starting, restarting, setting Up|
|Gray||Compute deleting, stopping|
An indicator next to the Kernel dropdown shows its status.
|Green||Kernel connected, idle, busy|
|Gray||Kernel not connected|
Find compute details
Find details about your compute instances on the Compute page in studio.
If you can't connect to a notebook, ensure that web socket communication is not disabled. For compute instance Jupyter functionality to work, web socket communication must be enabled. Please ensure your network allows websocket connections to *.instances.azureml.net and *.instances.azureml.ms.
When compute instance is deployed in a private link workspace it can be only be accessed from within virtual network. If you are using custom DNS or hosts file please add an entry for
. .instances.azureml.ms with private IP address of workspace private endpoint. For more information see the custom DNS article.