Analyze guides created with Dynamics 365 Guides (Preview)

[This topic is pre-release documentation and is subject to change.]

Guides Analytics is part of the Microsoft Dynamics 365 Guides (Preview) application suite that includes the Dynamics 365 Guides PC authoring app and the Dynamics 365 Guides HoloLens app. Use Guides Analytics to analyze the usage of guides across your organization. Guides Analytics consists of Power BI visual reports that are populated with Dynamics 365 Guides usage data stored securely in your Dynamics 365 environment.

What data is collected and used in Guides Analytics?

When an operator uses the Dynamics 365 Guides HoloLens app in Operate mode, each gaze-and-commit interaction on the Next step and Go back buttons is recorded, together with the date and time of the interaction. Each operation of a guide in HoloLens Operate mode, whether completed from beginning to end of the guide or involving just a few steps, is called a run. Information about the guide, such as step number, task number, and guide name are also recorded. This data is stored in your private and secure Dynamics 365 environment.

What can you do with the data?

The Guides Analytics reports are designed to help you answer high-level questions about guides usage. For example:

  • How many guides have been used to date?

  • Is the number of times a guide is run per day increasing, decreasing, or remaining stable over time?

  • Which guides take the most time to complete?

You can also use Guides Analytics to drill into detailed time-tracking information at the task and step levels. For example, answer questions such as:

  • Which step of a guide takes the most time?

  • Which step of a guide has the most variability in operator time?

These reports provide information about operator adoption and usage and give guide authors a data-driven way to improve their guides. For example, an author could focus their editing efforts on steps that take a long time to execute or show a high degree of variability among operators. These reports are also valuable in training scenarios for both trainers and trainees to better understand performance and improvement over time.

Open Guides Analytics

Set up your reports for the first time

You can set up Guide Analytics for the first time through the Dynamics 365 Guides PC authoring app.

Note

Guides Analytics requires the freely available Power BI Desktop application. If you don’t have permission to install Power BI Desktop on your computer, ask your admin about sharing the reports through the Power BI Service.

To set up your reports:

  1. In the Dynamics 365 Guides PC authoring app, select the Analyze tab, copy the highlighted Instance URI text, and then select Continue to go to the Microsoft Download Center.

    Analyze tab)

  2. In the Microsoft Download Center, select Download.

    Microsoft Download Center)

    You’ll be prompted to choose the files to download:

    • Guides Analytics Template. You can configure this Power BI template file to display Dynamics 365 Guides time-tracking data from within your organization. This is the main component of Guides Analytics.

    • Guides Analytics Demo. You can use this Power BI file to view an example data set. It does not require any configuration and lets you get an overview of Guides Analytics before you even create your first guide.

    We recommend downloading both files.

    Files to download)

  3. Open the downloaded Guides Analytics Template.pbit file with Power BI Desktop. Use your Dynamics 365 Guides username and password if you’re prompted to sign in to Power BI.

  4. When prompted, paste the Instance URI into the text box as shown here. This is the same Instance URI you copied from the Analyze tab in the PC authoring app in step 1.

    Guides Analytics template)

    You might see the following error message saying you aren’t signed in:

    Sign-in error)

    In that case, select Sign in, and enter your Dynamics 365 Guides username and password to connect the template to your organization’s secure Dynamics 365 environment.

  5. You should now see the template populated with data from your own guides. If you haven't operated any guides yet, your reports might appear blank. The reports are described in detail in “Take a tour of reports” later in this topic.

    Example report)

  6. Save the configured reports to a convenient place on your computer for later use.

  7. Select Refresh on the Home ribbon to update your reports with the most recent Dynamics 365 Guides data.

Open your reports

Once you have set up and saved the Guides Analytics Template on your computer, open Power BI Desktop, and then open your saved report. Power BI Desktop has a File – Open – Recent items list that's convenient for finding your previously opened reports.

Take a tour of reports

Both the Guides Analytics Template and Guides Analytics Demo files contain two reports: Guides Usage and Process Time-Tracking.

Guides Usage report

The Guides Usage report provides an overview of all the guides used in your organization. The following graphic illustrates the parts of the report.

Guides Usage report)

  1. Which guides are included in the report.

    Use the drop-down menu to select which guides are used to generate the visuals and statistics in the report. Changing the selection in this drop-down menu changes the values in all parts of the report. By default, the All option is selected to give you an overview of all your organization’s guides.

  2. Use the summary statistics to quickly answer the following questions:

    • Guides. How many guides have been used by at least one operator to date?

    • Users. How many users have operated at least one guide to date?

    • Devices. How many devices have been used to operate at least one guide to date?

    • Runs. How many total runs have been completed to date?

  3. Is daily guide usage changing?

    The bar chart of run counts (y-axis) per day (x-axis) allows you to see trends such as increasing, decreasing, or stable daily guides usage.

    Drill up/Expand to the next level. In Power BI, dates have a hierarchy of year, quarter, month, day. By default, this bar chart displays run counts per day. To see total run counts per month, first select the chart, and then select Drill Up.

    Drill-up button)

    To return to the per-day view, select Drill Mode, and then select the month bar you want to drill into.

    Drill Mode button)

    Alternatively, select the Expand to the next level button to drill back down.

    Expand to next level)

    Filter by Date. Change the date range by using the Filter by Date slicer. Select the start or end date to set them manually, or move the slider.

    Note

    The date filter is applied to all visuals and statistics in the report.

  4. What is the most frequently used guide?

    The bar chart of run counts (x-axis) per guide (y-axis) allows you to quickly identify which guides are used most and least in your organization (top and bottom of the chart respectively). If you have many guides, you might need to scroll within this chart.

  5. What is the average run time per guide?

    The bar chart of average run time in minutes (x-axis) per guide (y-axis) allows you to quickly identify the guides that take the most or least amount of time to operate (top and bottom of chart respectively). If you have many guides, you might need to scroll within this chart.

Process Time-Tracking report

Use the Process Time-Tracking report to drill into usage and step-level run-time data for a single guide. The following graphic illustrates the parts of the report.

Process Time-Tracking report)

  1. Which guides are included in the report?

    Use the drop-down menu to select a single guide. Changing the selection in the drop-down menu changes the values in all parts of the report to correspond to data for that single guide.

  2. Use the summary statistics to quickly answer the following questions:

    • Users. How many users have run this guide at least once?

    • Devices. How many devices have been used to operate this guide at least once to date?

    • Runs. How many total runs of this guide have been completed to date?

  3. Is daily guide usage changing?

    This is the same chart that’s shown in the Guides Usage report described earlier.

  4. How long is a guide run in minutes?

    You can see the average run time of this guide, in addition to the longest run time (max) and shortest run time (min) in minutes to get an overview of how long this guide takes to operate.

  5. How long did each task or step take?

    This line chart shows the time in minutes (y-axis) for each step of a guide (x-axis) to give you a sense for which steps take the most time and which steps have the most variability in run time. Each run of the guide is shown as a separate colored line. The chart legend provides a list of all runs sorted by run start time.

    Drill up/Drill down/Expand to the next level. By default, this chart shows the run time in minutes per step. The x-axis indicates both the step numbers (upper labels) and parent task labels (lower labels). Guide tasks and steps are organized into a hierarchy.

    To change the view from the step level to the task level, first select the chart, and then select Drill Up.

    Drill Up button)

    To return to the step view, select Drill Mode, and then select the task you want to drill in to.

    Drill Mode button)

    Alternatively, select the Expand to the next level button to drill back down. This option will expand all tasks to the step level, whereas Drill Mode only drills into the data item you selected.

    Next level hierarchy)

  6. Select a recent run:

    To view data for a single recent run, select it from the run table. By default, this table is sorted by the Run Start time with the most recent run on the top. You can also select the column headers to sort by Run Time. If you select a single row in this table, all visuals and statistics are filtered to just that single run.

  7. Filter by Date or Step Time (minutes):

    There are situations in which you might want to filter the report to show just runs generated in a particular date range or runs that are within some step time range. For example:

    • Compare versions of a guide. The date filter is particularly useful if you made a revision to your guide (for example, added or removed a step) and you want to show data for a given version of the guide that can be identified based on the date the guide was created or edited.

    • Filter outliers. Unusually long step times can stretch the y-axis of the time-per-step line chart, which can make the majority of data difficult to see. Use this slider to set the range of step times you want to visualize across the report so you can ignore the outliers.

Share the Guides Analytics reports

You can share your Guides Analytics Power BI reports within your organization by publishing them to the Power BI Service. This allows anyone in your organization with a Power BI Pro license to access the report through the Power BI Service web interface accessible at https://powerbi.microsoft.com.

Power BI provides several mechanisms for sharing reports with others in your organization. We recommend reading Ways to share your work in Power BI for an overview. A great way to share your reports within your organization in a read-only fashion is to publish them as a Power BI app. This involves the following well-documented steps:

  1. Create a workspace in the Power BI Service.

  2. Publish your Guides Analytics reports to this workspace using Power BI Desktop.

  3. Publish the contents of your workspace as an app in the Power BI Service.

See also

Overview of authoring a guide
Operating a guide
FAQ