Connect to and manage an Azure SQL Managed Instance in Microsoft Purview

This article outlines how to register and Azure SQL Managed Instance, as well as how to authenticate and interact with the Azure SQL Managed Instance in Microsoft Purview. For more information about Microsoft Purview, read the introductory article

Supported capabilities

Metadata Extraction Full Scan Incremental Scan Scoped Scan Classification Access Policy Lineage Data Sharing
Yes Yes Yes Yes Yes No Limited** No

** Lineage is supported if dataset is used as a source/sink in Data Factory Copy activity

Prerequisites

Register

This section describes how to register an Azure SQL Managed Instance in Microsoft Purview using the Microsoft Purview governance portal.

Authentication for registration

If you need to create new authentication, you need to authorize database access to SQL Database Managed Instance. There are three authentication methods that Microsoft Purview supports today:

System or user assigned managed identity to register

You can use either your Microsoft Purview system-assigned managed identity (SAMI), or a user-assigned managed identity (UAMI) to authenticate. Both options allow you to assign authentication directly to Microsoft Purview, like you would for any other user, group, or service principal. The Microsoft Purview system-assigned managed identity is created automatically when the account is created and has the same name as your Microsoft Purview account. A user-assigned managed identity is a resource that can be created independently. To create one, you can follow our user-assigned managed identity guide.

You can find your managed identity Object ID in the Azure portal by following these steps:

For Microsoft Purview account’s system-assigned managed identity:

  1. Open the Azure portal, and navigate to your Microsoft Purview account.
  2. Select the Properties tab on the left side menu.
  3. Select the Managed identity object ID value and copy it.

For user-assigned managed identity (preview):

  1. Open the Azure portal, and navigate to your Microsoft Purview account.
  2. Select the Managed identities tab on the left side menu
  3. Select the user assigned managed identities, select the intended identity to view the details.
  4. The object (principal) ID is displayed in the overview essential section.

Either managed identity will need permission to get metadata for the database, schemas and tables, and to query the tables for classification.

Service Principal to register

There are several steps to allow Microsoft Purview to use service principal to scan your Azure SQL Managed Instance.

Create or use an existing service principal

To use a service principal, you can use an existing one or create a new one. If you're going to use an existing service principal, skip to the next step. If you have to create a new Service Principal, follow these steps:

  1. Navigate to the Azure portal.
  2. Select Azure Active Directory from the left-hand side menu.
  3. Select App registrations.
  4. Select + New application registration.
  5. Enter a name for the application (the service principal name).
  6. Select Accounts in this organizational directory only.
  7. For Redirect URI, select Web and enter any URL you want; it doesn't have to be real or work.
  8. Then select Register.

Configure Azure AD authentication in the database account

The service principal must have permission to get metadata for the database, schemas, and tables. It must also be able to query the tables to sample for classification.

Add service principal to key vault and Microsoft Purview's credential

It's required to get the service principal's application ID and secret:

  1. Navigate to your Service Principal in the Azure portal
  2. Copy the values the Application (client) ID from Overview and Client secret from Certificates & secrets.
  3. Navigate to your key vault
  4. Select Settings > Secrets
  5. Select + Generate/Import and enter the Name of your choice and Value as the Client secret from your Service Principal
  6. Select Create to complete
  7. If your key vault isn't connected to Microsoft Purview yet, you'll need to create a new key vault connection
  8. Finally, create a new credential using the Service Principal to set up your scan.

SQL authentication to register

Note

Only the server-level principal login (created by the provisioning process) or members of the loginmanager database role in the master database can create new logins. It takes about 15 minutes after granting permission, the Microsoft Purview account should have the appropriate permissions to be able to scan the resource(s).

You can follow the instructions in CREATE LOGIN to create a login for Azure SQL Managed Instance if you don't have this login available. You'll need username and password for the next steps.

  1. Navigate to your key vault in the Azure portal
  2. Select Settings > Secrets
  3. Select + Generate/Import and enter the Name and Value as the password from your Azure SQL Managed Instance
  4. Select Create to complete
  5. If your key vault isn't connected to Microsoft Purview yet, you'll need to create a new key vault connection
  6. Finally, create a new credential using the username and password to set up your scan.

Steps to register

  1. Navigate to your Microsoft Purview governance portal

  2. Select Data Map on the left navigation.

  3. Select Register

  4. Select Azure SQL Managed Instance and then Continue.

  5. Select From Azure subscription, select the appropriate subscription from the Azure subscription drop-down box and the appropriate server from the Server name drop-down box.

  6. Provide the public endpoint fully qualified domain name and port number. Then select Register to register the data source.

    Screenshot of register sources screen, with Name, subscription, server name, and endpoint filled out.

    For Example: foobar.public.123.database.windows.net,3342

Scan

Follow the steps below to scan an Azure SQL Managed Instance to automatically identify assets and classify your data. For more information about scanning in general, see our introduction to scans and ingestion

Create and run scan

To create and run a new scan, complete the following steps:

  1. Select the Data Map tab on the left pane in the Microsoft Purview governance portal.

  2. Select the Azure SQL Managed Instance source that you registered.

  3. Select New scan

  4. Select the credential to connect to your data source.

    Screenshot of new scan window, with the Purview MSI selected as the credential, but a service principal, or SQL authentication also available.

  5. You can scope your scan to specific tables by choosing the appropriate items in the list.

    Screenshot of the scope your scan window, with a subset of tables selected for scanning.

  6. Then select a scan rule set. You can choose between the system default, existing custom rule sets, or create a new rule set inline.

    Screenshot of scan rule set window, with the system default scan rule set selected.

  7. Choose your scan trigger. You can set up a schedule or run the scan once.

    Screenshot of the set scan trigger window, with the recurring tab selected.

  8. Review your scan and select Save and run.

View your scans and scan runs

To view existing scans, do the following:

  1. Go to the Microsoft Purview governance portal. Select the Data Map tab under the left pane.

  2. Select the desired data source. You will see a list of existing scans on that data source under Recent scans, or can view all scans under the Scans tab.

  3. Select the scan that has results you want to view.

  4. This page will show you all of the previous scan runs along with the status and metrics for each scan run. It will also display whether your scan was scheduled or manual, how many assets had classifications applied, how many total assets were discovered, the start and end time of the scan, and the total scan duration.

Manage your scans - edit, delete, or cancel

To manage or delete a scan, do the following:

  1. Go to the Microsoft Purview governance portal. Select the Data Map tab under the left pane.

  2. Select the desired data source. You will see a list of existing scans on that data source under Recent scans, or can view all scans under the Scans tab.

  3. Select the scan you would like to manage. You can edit the scan by selecting Edit scan.

  4. You can cancel an in progress scan by selecting Cancel scan run.

  5. You can delete your scan by selecting Delete scan.

Note

  • Deleting your scan does not delete catalog assets created from previous scans.
  • The asset will no longer be updated with schema changes if your source table has changed and you re-scan the source table after editing the description in the schema tab of Microsoft Purview.

Next steps

Now that you've registered your source, follow the below guides to learn more about Microsoft Purview and your data.