Manage compute resources for model training and deployment in studio

In this article, learn how to manage the compute resources you use for model training and deployment in Azure Machine studio.

Prerequisites

What's a compute target?

With Azure Machine Learning, you can train your model on a variety of resources or environments, collectively referred to as compute targets). A compute target can be a local machine or a cloud resource, such as an Azure Machine Learning Compute, Azure HDInsight, or a remote virtual machine.

You can also use serverless compute as a compute target. There's nothing for you to manage when you use serverless compute.

View compute targets

To see all compute targets for your workspace, use the following steps:

  1. Navigate to Azure Machine Learning studio.

  2. Under Manage, select Compute.

  3. Select tabs at the top to show each type of compute target.

    Screenshot of view list of compute targets.

Important

If your compute instance or compute clusters are based on any of these series, recreate with another VM size before their retirement date to avoid service disruption.

These series are retiring on August 31, 2023:

These series are retiring on August 31, 2024:

Compute instance and clusters

You can create compute instances and compute clusters in your workspace, using the Azure Machine Learning SDK, CLI, or studio:

In addition, you can use the VS Code extension to create compute instances and compute clusters in your workspace.

Kubernetes clusters

For information on configuring and attaching a Kubernetes cluster to your workspace, see Configure Kubernetes cluster for Azure Machine Learning.

Other compute targets

To use VMs created outside the Azure Machine Learning workspace, you must first attach them to your workspace. Attaching the compute resource makes it available to your workspace.

  1. Navigate to Azure Machine Learning studio.

  2. Under Manage, select Compute.

  3. In the tabs at the top, select Attached compute to attach a compute target for training.

  4. Select +New, then select the type of compute to attach. Not all compute types can be attached from Azure Machine Learning studio.

  5. Fill out the form and provide values for the required properties.

    Note

    Microsoft recommends that you use SSH keys, which are more secure than passwords. Passwords are vulnerable to brute force attacks. SSH keys rely on cryptographic signatures. For information on how to create SSH keys for use with Azure Virtual Machines, see the following documents:

  6. Select Attach.

To detach your compute use the following steps:

  1. In Azure Machine Learning studio, select Compute, Attached compute, and the compute you wish to remove.
  2. Use the Detach link to detach your compute.

Connect with SSH access

After you create a compute with SSH access enabled, use these steps for access.

  1. Find the compute in your workspace resources:

    1. On the left, select Compute.
    2. Use the tabs at the top to select Compute instance or Compute cluster to find your machine.
  2. Select the compute name in the list of resources.

  3. Find the connection string:

    • For a compute instance, select Connect at the top of the Details section.

      Screenshot that shows connect tool at the top of the Details page.

    • For a compute cluster, select Nodes at the top, then select the Connection string in the table for your node. Screenshot that shows connection string for a node in a compute cluster.

  4. Copy the connection string.

  5. For Windows, open PowerShell or a command prompt:

    1. Go into the directory or folder where your key is stored

    2. Add the -i flag to the connection string to locate the private key and point to where it is stored:

      ssh -i <keyname.pem> azureuser@... (rest of connection string)

  6. For Linux users, follow the steps from Create and use an SSH key pair for Linux VMs in Azure

  7. For SCP use:

    scp -i key.pem -P {port} {fileToCopyFromLocal } azureuser@yourComputeInstancePublicIP:~/{destination}

Next steps