How to use Azure Monitor workbooks for Azure Active Directory reports
Important
In order to optimize the underlying queries in this workbook, please click on "Edit", click on Settings icon and select the workspace where you want to run these queries. Workbooks by default will select all workspaces where you are routing your Azure AD logs.
Do you want to:
Understand the effect of your Conditional Access policies on your users' sign-in experience?
Troubleshoot sign-in failures to get a better view of your organization's sign-in health and to resolve issues quickly?
Understand risky users and risk detections trends in your tenant?
Know who's using legacy authentications to sign in to your environment? (By blocking legacy authentication, you can improve your tenant's protection.)
Do you need to understand the impact of Conditional Access policies in your tenant?
Would you like the ability to review: sign-in log queries, with a workbook that reports how many users were granted or denied access, as well as how many users bypassed Conditional Access policies when accessing resources?
Interested in developing a deeper understanding of conditional access, with a workbook details per condition so that the impact of a policy can be contextualized per condition, including device platform, device state, client app, sign-in risk, location, and application?
Archive and report on more than one year of historical application role and access package assignment activity?
To help you to address these questions, Azure Active Directory provides workbooks for monitoring. Azure Monitor workbooks combine text, analytics queries, metrics, and parameters into rich interactive reports.
This article:
Assumes you're familiar with how to Create interactive reports by using Monitor workbooks.
Explains how to use Monitor workbooks to understand the effect of your Conditional Access policies, to troubleshoot sign-in failures, and to identify legacy authentications.
Prerequisites
To use Monitor workbooks, you need:
An Azure Active Directory tenant with a premium (P1 or P2) license. Learn how to get a premium license.
Access to the log analytics workspace
Following roles in Azure Active Directory (if you are accessing Log Analytics through Azure Active Directory portal)
- Security administrator
- Security reader
- Report reader
- Global administrator
Roles
To access workbooks in Azure Active Directory, you must have access to the underlying Log Analytics workspace and be assigned to one of the following roles:
Global Reader
Reports Reader
Security Reader
Application Administrator
Cloud Application Administrator
Company Administrator
Security Administrator
Workbook access
To access workbooks:
Sign in to the Azure portal.
Navigate to Azure Active Directory > Monitoring > Workbooks.
Select a report or template, or on the toolbar select Open.

Sign-in analysis
To access the sign-in analysis workbook, in the Usage section, select Sign-ins.
This workbook shows the following sign-in trends:
All sign-ins
Success
Pending user action
Failure
You can filter each trend by the following categories:
Time range
Apps
Users

For each trend, you get a breakdown by the following categories:
Location

Device

Sign-ins using legacy authentication
To access the workbook for sign-ins that use legacy authentication, in the Usage section, select Sign-ins using Legacy Authentication.
This workbook shows the following sign-in trends:
All sign-ins
Success
You can filter each trend by the following categories:
Time range
Apps
Users
Protocols

For each trend, you get a breakdown by app and protocol.

Sign-ins by Conditional Access
To access the workbook for sign-ins by Conditional Access policies, in the Conditional Access section, select Sign-ins by Conditional Access.
This workbook shows the trends for disabled sign-ins. You can filter each trend by the following categories:
Time range
Apps
Users

For disabled sign-ins, you get a breakdown by the Conditional Access status.

Conditional Access Insights
Overview
Workbooks contain sign-in log queries that can help IT administrators monitor the impact of Conditional Access policies in their tenant. You have the ability to report on how many users would have been granted or denied access. The workbook contains insights on how many users would have bypassed Conditional Access policies based on those users’ attributes at the time of sign-in. It contains details per condition so that the impact of a policy can be contextualized per condition, including device platform, device state, client app, sign-in risk, location, and application.
Instructions
To access the workbook for Conditional Access Insights, select the Conditional Access Insights workbook in the Conditional Access section. This workbook shows the expected impact of each Conditional Access policy in your tenant. Select one or more Conditional Access policies from the dropdown list and narrow the scope of the workbook by applying the following filters:
Time Range
User
Apps
Data View

The Impact Summary shows the number of users or sign-ins for which the selected policies had a particular result. Total is the number of users or sign-ins for which the selected policies were evaluated in the selected Time Range. Click on a tile to filter the data in the workbook by that result type.

This workbook also shows the impact of the selected policies broken down by each of six conditions:
- Device state
- Device platform
- Client apps
- Sign-in risk
- Location
- Applications

You can also investigate individual sign-ins, filtered by the parameters selected in the workbook. Search for individual users, sorted by sign-in frequency, and view their corresponding sign-in events.

Sign-ins by grant controls
To access the workbook for sign-ins by grant controls, in the Conditional Access section, select Sign-ins by Grant Controls.
This workbook shows the following disabled sign-in trends:
Require MFA
Require terms of use
Require privacy statement
Other
You can filter each trend by the following categories:
Time range
Apps
Users

For each trend, you get a breakdown by app and protocol.

Sign-ins failure analysis
Use the Sign-ins failure analysis workbook to troubleshoot errors with:
- Sign-ins
- Conditional Access policies
- Legacy authentication
To access the sign-ins by Conditional Access data, in the Troubleshoot section, select Sign-ins using Legacy Authentication.
This workbook shows the following sign-in trends:
All sign-ins
Success
Pending action
Failure
You can filter each trend by the following categories:
Time range
Apps
Users

To help you troubleshoot sign-ins, Azure Monitor gives you a breakdown by the following categories:
Top errors

Sign-ins waiting on user action

Identity Protection Risk Analysis
Use the Identity Protection Risk Analysis workbook in the Usage section to understand:
- Distribution in risky users and risk detections by levels and types
- Opportunities to better remediate risk
- Where in the world risk is being detected
You can filter the Risky Detections trends by:
- Detection timing type
- Risk level
Real-time risk detections are those that can be detected at the point of authentication. These detections can be challenged by risky sign-in policies using Conditional Access to require multi-factor authentication.
You can filter the Risky Users trends by:
- Risk detail
- Risk level
If you have a high number of risky users where "no action" has been taken, consider enabling a Conditional Access policy to require secure password change when a user is high risk.
Best practices
Query partially succeeded
After running a workbook, you might see the following error: "Query partially succeeded; results may be incomplete or incorrect"
This error means that your query timed out in the database layer. In this case, it still “succeeded” to workbooks (it got results) but the results also contained an error/warning message that some part of the query failed. In this case, you review your query and start troubleshooting by reducing the scope of it. For example, you could add or rearrange a where condition to reduce the amount of data the query has to process.
Next steps
Povratne informacije
Pošalјite i prikažite povratne informacije za